-- Logs begin at Mon 2022-09-19 16:29:31 UTC, end at Mon 2022-09-19 17:26:00 UTC. -- Sep 19 16:55:30.364462 dv-cinder-848013-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 19 16:55:30.373484 dv-cinder-848013-2-smb devstack@keystone.service[81575]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 19 16:55:30.375635 dv-cinder-848013-2-smb devstack@keystone.service[81575]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 16:55:30 2022] *** Sep 19 16:55:30.375635 dv-cinder-848013-2-smb devstack@keystone.service[81575]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 16:55:30.375635 dv-cinder-848013-2-smb devstack@keystone.service[81575]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 16:55:30.375635 dv-cinder-848013-2-smb devstack@keystone.service[81575]: nodename: dv-cinder-848013-2-smb Sep 19 16:55:30.375635 dv-cinder-848013-2-smb devstack@keystone.service[81575]: machine: x86_64 Sep 19 16:55:30.375635 dv-cinder-848013-2-smb devstack@keystone.service[81575]: clock source: unix Sep 19 16:55:30.375635 dv-cinder-848013-2-smb devstack@keystone.service[81575]: pcre jit disabled Sep 19 16:55:30.375635 dv-cinder-848013-2-smb devstack@keystone.service[81575]: detected number of CPU cores: 4 Sep 19 16:55:30.375635 dv-cinder-848013-2-smb devstack@keystone.service[81575]: current working directory: / Sep 19 16:55:30.375635 dv-cinder-848013-2-smb devstack@keystone.service[81575]: detected binary path: /usr/bin/uwsgi-core Sep 19 16:55:30.376209 dv-cinder-848013-2-smb devstack@keystone.service[81575]: your processes number limit is 47680 Sep 19 16:55:30.376209 dv-cinder-848013-2-smb devstack@keystone.service[81575]: your memory page size is 4096 bytes Sep 19 16:55:30.376209 dv-cinder-848013-2-smb devstack@keystone.service[81575]: detected max file descriptor number: 2048 Sep 19 16:55:30.376209 dv-cinder-848013-2-smb devstack@keystone.service[81575]: lock engine: pthread robust mutexes Sep 19 16:55:30.376209 dv-cinder-848013-2-smb devstack@keystone.service[81575]: thunder lock: enabled Sep 19 16:55:30.376209 dv-cinder-848013-2-smb devstack@keystone.service[81575]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 19 16:55:30.376209 dv-cinder-848013-2-smb devstack@keystone.service[81575]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 16:55:30.416043 dv-cinder-848013-2-smb devstack@keystone.service[81575]: Python main interpreter initialized at 0x5572da1999c0 Sep 19 16:55:30.416043 dv-cinder-848013-2-smb devstack@keystone.service[81575]: python threads support enabled Sep 19 16:55:30.416043 dv-cinder-848013-2-smb devstack@keystone.service[81575]: your server socket listen backlog is limited to 100 connections Sep 19 16:55:30.416043 dv-cinder-848013-2-smb devstack@keystone.service[81575]: your mercy for graceful operations on workers is 90 seconds Sep 19 16:55:30.416362 dv-cinder-848013-2-smb devstack@keystone.service[81575]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 16:55:30.416442 dv-cinder-848013-2-smb devstack@keystone.service[81575]: *** Operational MODE: preforking *** Sep 19 16:55:30.416704 dv-cinder-848013-2-smb devstack@keystone.service[81575]: *** uWSGI is running in multiple interpreter mode *** Sep 19 16:55:30.416704 dv-cinder-848013-2-smb devstack@keystone.service[81575]: spawned uWSGI master process (pid: 81575) Sep 19 16:55:30.416915 dv-cinder-848013-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 19 16:55:30.418947 dv-cinder-848013-2-smb devstack@keystone.service[81575]: spawned uWSGI worker 1 (pid: 81585, cores: 1) Sep 19 16:55:30.418947 dv-cinder-848013-2-smb devstack@keystone.service[81575]: spawned uWSGI worker 2 (pid: 81586, cores: 1) Sep 19 16:55:30.418947 dv-cinder-848013-2-smb devstack@keystone.service[81575]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 16:55:34.645234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 16:55:34.645234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: from cryptography.utils import int_from_bytes Sep 19 16:55:34.646654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 16:55:34.646654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: from cryptography.utils import int_from_bytes Sep 19 16:55:34.646654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 16:55:34.646654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: from cryptography.utils import int_from_bytes Sep 19 16:55:34.647358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 16:55:34.647358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: from cryptography.utils import int_from_bytes Sep 19 16:55:34.695567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 16:55:34.695741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 16:55:34.695838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 16:55:34.695913 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 16:55:34.695973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] command line args: [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 16:55:34.696036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] command line args: [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 16:55:34.696180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 16:55:34.696345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 16:55:34.696487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ================================================================================ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 16:55:34.696570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ================================================================================ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 16:55:34.696632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] admin_token = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.696807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] admin_token = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.696940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] config_dir = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.697016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config_dir = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.697125 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.697192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] config_source = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.697248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.697379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] debug = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.697527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] config_source = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.697527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] debug = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.697659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.699946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700008 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_config_append = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_config_append = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_dir = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_dir = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700498 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.700939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701427 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701823 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.701914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.702050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.702148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.702294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.702391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.702561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.702640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.702825 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.702938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.703323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.703402 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.703566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] publish_errors = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.703712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] publish_errors = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.703791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.703872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.703944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.704024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.704136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.704223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.704378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.704510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.704634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.704741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.704856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] standard_threads = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.704966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] standard_threads = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.705089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.705215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.705328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.705435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.705550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.705662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.705776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] use_journal = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.705957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_journal = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.706078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] use_json = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.706188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_json = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.706302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] use_stderr = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.706412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_stderr = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.706520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] use_syslog = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.706641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] use_syslog = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.706752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.706861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 16:55:34.706970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.707085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.707195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.707312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.707428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.707544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.707660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.707770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.707879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.707999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.708115 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.708231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.708341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.708457 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.708566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.708685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.708802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.708920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.709055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.709168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.709288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.709407 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.709524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.709639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.709755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.709866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.709975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.710095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.710206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.710360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.710477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.710588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.710698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.710815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.710927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.711036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.711145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.711253 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.711362 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.711548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.711661 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.711769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.711878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.711988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.712104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.712271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.712381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.712490 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.712598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.712714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.712833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.712944 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.713096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.713210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.713319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.713428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.713549 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.713666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.713782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.713898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.714014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.714130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.714252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.714362 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.714477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.714592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.714702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.714810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.714933 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.715049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.715159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.715268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.715376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.715484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.715605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.715715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.715824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.715932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.716040 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.716149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.716265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.716376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.716484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.716592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.716700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.716807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.716994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.717120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.717231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.717340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.717449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.717558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.717679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.717805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.717920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.718030 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.718138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.718254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.718375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.718492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.718609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.718720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.718829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.718937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.719054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.719166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.719276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.719385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.719494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.719603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.719725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.719821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.719913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.720042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.720145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.720248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.720381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.720479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.720573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.720665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.720758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.720878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.721006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.721140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.721251 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.721374 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.721496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.721614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.721716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.721836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.721947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.722055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.722165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.722274 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.722383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.722492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.722602 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.722712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.722821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.722921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.723033 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.723153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.723257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.723366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.723481 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.723597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.723786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.723908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.724027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.724144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.724246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.724361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.724472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.724594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.724710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.724821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.724937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.725064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.725176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.725299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.725411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.725527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.725639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.725749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.725858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.725967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.726077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.726186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.726296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.726405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.726521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.726642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.726753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.726863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.726972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.727089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.727203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.727322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.727433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.727543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.727653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.727763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.727872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.728053 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.728165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.728275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.728385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.728494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.728613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.728733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.728852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.728969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.729132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.729245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.729355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.729464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.729590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.729709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.729821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.729931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.730040 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.730150 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.730268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.730421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.730535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.730636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.730744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.730854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.730972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.731083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.731193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.731302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.731412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.731548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.731676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.external = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.731797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.external = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.731920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.732032 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.732142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.732254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.732366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.732476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.732594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.password = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.732706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.password = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.732827 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.token = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.732941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] auth.token = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.733067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.733180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.733302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.733415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.733525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.733635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.733745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.733855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.733974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.734086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.734197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.734306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.734416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.734526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.734644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.734755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.734865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.734975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.735092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.735205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.735323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.735436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.735546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.735656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.735766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.735876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.735995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.736107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.736217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.736327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.736436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.736552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.736671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.736783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.736893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.737003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.737158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.737270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.737393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.737505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.737616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.737726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.737837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.737947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.738090 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.738208 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.738319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.738440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.738552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.738662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.738786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.738898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.739038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.739153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.739296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.739410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.739554 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.739671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.739782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.739892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.740042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.740165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.740278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.740388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.740528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.740641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.740752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.740870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.740990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.741120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.741261 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.741376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.741515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.741707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.741822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.741932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.742044 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.742156 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.742267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.742387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.742499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.742610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.742720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.742830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.742940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.743059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.743175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.743286 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.743398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.743508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.743618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.743736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.743847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.743958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.744068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.744178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.744295 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.744414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.744527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.744637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.744772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.744887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.745049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.745179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.745293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.745403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.745571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.745686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.745797 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.745915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.746026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.746137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.746247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.746357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.746467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.746586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.746698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.746875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.746989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.747100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.747210 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.747329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.747442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.747552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.747662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.747773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.747884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.748002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.748114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.748225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.748342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.748453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.748564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.748688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.748800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.748918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.749063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.749179 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.749290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.749412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.749525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.749636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.749748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.749865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.750249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.750363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.750473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.750621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.750736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.750848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.750966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.751080 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.751191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.751300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.751410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.751520 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.751638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.751750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.751862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.751972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.752081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.752191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.752308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.752420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.752530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.752640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.752750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.752864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.752982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.753109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.753212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.753306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.753400 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.753505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.753635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.753747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.753858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.753969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.754080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.754190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.754308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.754420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.754530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.754640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.754750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.754859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.755037 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.755150 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.755261 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.755371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.755480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.755591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.755713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.755825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.755942 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.756054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.756165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.756275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.756392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.756504 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.756615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.756725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.756835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.756952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.757094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.757208 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.757319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.757429 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.757538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.757653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.757772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.757884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.757994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.758106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.758242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.758357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.758475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.758587 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.758697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.758807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.758940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.759063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.759187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.759299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.759410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.759519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.759665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.759780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.759898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.760010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.760123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.760234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.760344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.760454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.760571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.760714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.760833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.760944 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.761073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.761187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.761310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.761423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.761533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.761643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.761754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.761863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.761981 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.762092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.762230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.762346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.762485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.762598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.762716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.762826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.762961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.763076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.763214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.763331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.763449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.763560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.763669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.763781 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.763911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.764025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.764208 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.764319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.764430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] role.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.764538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.764647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] role.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.764765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.764877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.764986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.765147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.765258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.765368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.765492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.765605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.765715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.765826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.765936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.766045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.766163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.766275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.766385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.766495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.766606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.766748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.766870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.766982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.767092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.767202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.767311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.767454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.767577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.767689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.767799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.767941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.768056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.768332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.768454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.768567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.768676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.768811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.768925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.769083 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.769209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.769342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.769457 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.769595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.769710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.769822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.769938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.770074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.770188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.770326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.770439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.770593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.770741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.770856 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.770966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.771076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.771185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.771302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.771760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.771870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.771979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.772111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.772225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.772343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.772453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.772585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.772699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.772810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.772917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.773101 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.773216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.773327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.773436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.773556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.773667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.773790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.773905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.774015 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.774124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.774236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.774346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.774464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.774576 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.774686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.774795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.774906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.775016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.775156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.775272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.775473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.775586 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.775696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.775807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.775931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.776043 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.776153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.776263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.776373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.776483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.776602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.776713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.776825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.776965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.777112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.777234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.777353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.777464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.777575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.777693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.777805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.777915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.778026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.778137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.778270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.778393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.778505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.778614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.778724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.778842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.778954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.779073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.779185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.779294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.779405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.779515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.779651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.779773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.779886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.779995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.780108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.780218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.780349 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.780472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.780585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.780695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.780841 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.780956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.781121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.781249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.781363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.781474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.781584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.781694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.781805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.781923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 16:55:34.782035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 16:55:34.782146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 16:55:34.811058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.811197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.811329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.811411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.811504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.811587 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.819865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.820086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.847890 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.848116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.848934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.849193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.901289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.901682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.949058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.949290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.950169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:34.950405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.106790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.107001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.107123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.107208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.107354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.107506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.107644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.107724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.107844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.107930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.108047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.108171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.130871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.131108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.131270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.131367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.131507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.131639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.131739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.131837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.131934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.132040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.132139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.132236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.132342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.132589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.143457 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.143773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.156734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.156895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.156964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.157183 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.157286 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.157417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.157499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.157649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.157744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.157861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.157941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.158122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.158250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.158341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 16:55:35.175111 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.175326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 16:55:35.175671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.175813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.175894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 16:55:35.176110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 16:55:35.176240 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.176375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.176454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.176561 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 16:55:35.176657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.176904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.176997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.177221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.177486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.177748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.186587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.186868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.187147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.187475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.188123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.188413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.188691 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.188987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.194543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.196074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.197495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.197782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.198075 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.198360 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.198645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.198907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.199048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.199195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.199278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.199440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.199565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.199714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.199873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.199965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.200155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.200279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.200373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.200680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.200953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.201253 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.201514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.201787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.223401 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.224828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.224953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.225237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.226353 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.226651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.230013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.230296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.230583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.231426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.231715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.232006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.237085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.237363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.238504 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.239174 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.243670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.243964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.244542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.244775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.245061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.245378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.245751 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.245904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.246014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.246124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.246384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.246681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.246965 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.247255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.247783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.248094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.268887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.268887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.273611 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.274023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.274322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.276812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.277134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.278875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.281364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.282124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.282428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.284464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.286652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.287720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.288029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.288319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.288613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.288899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.289228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.289851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.293113 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.293420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.293708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.293998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.294290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.294594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.305068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.305328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.305631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.305902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.310869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.311161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.311434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.311702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.312713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.314265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.315785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.316068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.318623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.318889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.319177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.319464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.319759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.320159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.320283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.321740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.322023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.324773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.325070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.325383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.325681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.326078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.331428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.331724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.332008 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.332293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.332678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.332970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.333328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.337367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.337659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.337948 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.338239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.338627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.338922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.339212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.348828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.351805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.354681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.354807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.356327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.357638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.357821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.358127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.358522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.360528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.362081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.363564 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.363850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.364254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.364998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.366494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.369432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.369836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.370125 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.370407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.370724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.372190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.375132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.375535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.375828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.376110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.378272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.378569 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.378849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.383986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.384283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.384573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.385855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.386143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.386434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.386712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.387002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.387282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.387565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.387831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.388211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.388533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.388818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.389120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.389392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.389653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.391471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 16:55:35.391775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.392060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.392347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.392641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.392921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.393227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.393495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.393784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.394072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.394350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.394621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.394890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.395259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 16:55:35.424310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5572da1999c0 pid: 81586 (default app) Sep 19 16:55:35.427709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf7c1b-a5e5-4fea-9409-cf464b186824 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:35.427994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf7c1b-a5e5-4fea-9409-cf464b186824 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:35.428268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf7c1b-a5e5-4fea-9409-cf464b186824 None None] PATH_INFO: `/v3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:35.429859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5572da1999c0 pid: 81585 (default app) Sep 19 16:55:35.432607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 791 bytes} [Mon Sep 19 16:55:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:42.275333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5959ca-6d5a-4d1d-a54f-03b42629bca7 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:42.276129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5959ca-6d5a-4d1d-a54f-03b42629bca7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:42.276129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5959ca-6d5a-4d1d-a54f-03b42629bca7 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:42.283471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:42.290559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:42.291044 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:42.291182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:42.364572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: INFO dbcounter [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] Registered counter for database keystone Sep 19 16:55:42.385914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG oslo_db.sqlalchemy.engines [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 16:55:42.393912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writer thread running {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 16:55:42.569775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG passlib.handlers.bcrypt [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81586) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 16:55:42.570166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG passlib.handlers.bcrypt [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81586) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 16:55:42.628154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:42.629836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:42.769740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 2/3] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 16:55:43.297146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5959ca-6d5a-4d1d-a54f-03b42629bca7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:43.368169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: INFO dbcounter [None req-bb5959ca-6d5a-4d1d-a54f-03b42629bca7 None None] Registered counter for database keystone Sep 19 16:55:43.398283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG oslo_db.sqlalchemy.engines [None req-bb5959ca-6d5a-4d1d-a54f-03b42629bca7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 16:55:43.406502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writer thread running {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 16:55:43.526622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5959ca-6d5a-4d1d-a54f-03b42629bca7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:43.532074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b53375-01d3-4b66-ae35-85a496632773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:43.532711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53375-01d3-4b66-ae35-85a496632773 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:43.532989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53375-01d3-4b66-ae35-85a496632773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:43.533281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b53375-01d3-4b66-ae35-85a496632773 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:43.542510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b53375-01d3-4b66-ae35-85a496632773 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:43.593655 dv-cinder-848013-2-smb devstack@keystone.service[81585]: WARNING keystone.common.rbac_enforcer.enforcer [None req-20b53375-01d3-4b66-ae35-85a496632773 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 16:55:43.593989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b53375-01d3-4b66-ae35-85a496632773 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:43.604095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 2/4] 10.222.0.76 () {58 vars in 1324 bytes} [Mon Sep 19 16:55:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:55:43.611205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:43.632773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501775b-f1fe-4af8-95ca-eae5c82cb4c4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:43.638595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7b6f6-819e-4323-8de3-976b864b0f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:43.639790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7b6f6-819e-4323-8de3-976b864b0f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:43.640073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7b6f6-819e-4323-8de3-976b864b0f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:43.640343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7b6f6-819e-4323-8de3-976b864b0f46 admin admin] PATH_INFO: `/v3/projects/1401206b2abd4d4db9b2a1ade1bdd499` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:43.642097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7b6f6-819e-4323-8de3-976b864b0f46 admin admin] RBAC: Authorizing `identity:get_project(project_id=1401206b2abd4d4db9b2a1ade1bdd499)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:43.695299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4cf7b6f6-819e-4323-8de3-976b864b0f46 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 16:55:43.695580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7b6f6-819e-4323-8de3-976b864b0f46 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:43.700216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 3/5] 10.222.0.76 () {56 vars in 1207 bytes} [Mon Sep 19 16:55:43 2022] GET /identity/v3/projects/1401206b2abd4d4db9b2a1ade1bdd499 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:45.795725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab426-e0f0-443f-b5bc-9e99c183ccf3 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:45.796749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab426-e0f0-443f-b5bc-9e99c183ccf3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:45.796749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab426-e0f0-443f-b5bc-9e99c183ccf3 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:45.803776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 3/6] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:45.810573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751561a-8c32-48f2-b308-4627b365b586 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:45.811248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751561a-8c32-48f2-b308-4627b365b586 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:45.811383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751561a-8c32-48f2-b308-4627b365b586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:45.840252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e751561a-8c32-48f2-b308-4627b365b586 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:45.841824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e751561a-8c32-48f2-b308-4627b365b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:45.850635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 19 16:55:46.110719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab426-e0f0-443f-b5bc-9e99c183ccf3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:46.132572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab426-e0f0-443f-b5bc-9e99c183ccf3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:46.138157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2097689-bb51-4164-9a81-34c2cb644245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:46.138768 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2097689-bb51-4164-9a81-34c2cb644245 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:46.139046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2097689-bb51-4164-9a81-34c2cb644245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:46.139322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2097689-bb51-4164-9a81-34c2cb644245 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:46.147810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2097689-bb51-4164-9a81-34c2cb644245 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:46.149637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2097689-bb51-4164-9a81-34c2cb644245 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:46.158582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 4/8] 10.222.0.76 () {58 vars in 1324 bytes} [Mon Sep 19 16:55:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 16:55:46.164283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751561a-8c32-48f2-b308-4627b365b586 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:46.174432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751561a-8c32-48f2-b308-4627b365b586 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:46.180559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3bb7b-fc9b-44b3-8ef9-078b1e6c29ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:46.181234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3bb7b-fc9b-44b3-8ef9-078b1e6c29ee admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:46.181520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3bb7b-fc9b-44b3-8ef9-078b1e6c29ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:46.181795 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3bb7b-fc9b-44b3-8ef9-078b1e6c29ee admin admin] PATH_INFO: `/v3/users/a0f31da57ad743c8a3b7c701031f1af9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:46.183347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3bb7b-fc9b-44b3-8ef9-078b1e6c29ee admin admin] RBAC: Authorizing `identity:get_user(user_id=a0f31da57ad743c8a3b7c701031f1af9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:46.185239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3bb7b-fc9b-44b3-8ef9-078b1e6c29ee admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:46.186787 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 5/9] 10.222.0.76 () {56 vars in 1198 bytes} [Mon Sep 19 16:55:46 2022] GET /identity/v3/users/a0f31da57ad743c8a3b7c701031f1af9 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:48.352007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad71a16-52c3-415a-beee-37078ab98d9e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:48.352568 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad71a16-52c3-415a-beee-37078ab98d9e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:48.352568 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad71a16-52c3-415a-beee-37078ab98d9e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:48.353941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:48.359416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f67b3-9fc7-45dc-951a-67f8ee999f5e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:48.359837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f67b3-9fc7-45dc-951a-67f8ee999f5e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:48.360054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f67b3-9fc7-45dc-951a-67f8ee999f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:48.378476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0d4f67b3-9fc7-45dc-951a-67f8ee999f5e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:48.379645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0d4f67b3-9fc7-45dc-951a-67f8ee999f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:48.416161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9fb8-6e61-47d0-ba7b-f820cb5650f2 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:48.416347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9fb8-6e61-47d0-ba7b-f820cb5650f2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:48.416617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9fb8-6e61-47d0-ba7b-f820cb5650f2 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:48.417978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 6/11] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:55:48.422792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8acc5c-166e-4da1-978f-a4747af506dd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:48.423050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8acc5c-166e-4da1-978f-a4747af506dd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:48.423321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8acc5c-166e-4da1-978f-a4747af506dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:48.462207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 6/12] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:55:48.465238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG passlib.handlers.bcrypt [None req-0a8acc5c-166e-4da1-978f-a4747af506dd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81585) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 16:55:48.465712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG passlib.handlers.bcrypt [None req-0a8acc5c-166e-4da1-978f-a4747af506dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81585) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 16:55:48.514554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0a8acc5c-166e-4da1-978f-a4747af506dd None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:48.516188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0a8acc5c-166e-4da1-978f-a4747af506dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:48.616805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 7/13] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:55:48.725434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f67b3-9fc7-45dc-951a-67f8ee999f5e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:48.749723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:48.831143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f67b3-9fc7-45dc-951a-67f8ee999f5e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:48.863555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec974d8-c9cf-41e5-8a1f-921070f90a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:48.864202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec974d8-c9cf-41e5-8a1f-921070f90a77 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:48.864482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec974d8-c9cf-41e5-8a1f-921070f90a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:48.864758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec974d8-c9cf-41e5-8a1f-921070f90a77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:48.875727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec974d8-c9cf-41e5-8a1f-921070f90a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:55:48.878328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8acc5c-166e-4da1-978f-a4747af506dd None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7ec974d8-c9cf-41e5-8a1f-921070f90a77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:55:48.885027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:55:48.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:55:48.889655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 7/14] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:55:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:55:48.891938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec974d8-c9cf-41e5-8a1f-921070f90a77 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:48.974811 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:48.980571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8acc5c-166e-4da1-978f-a4747af506dd None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:48.982865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:48.994177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec974d8-c9cf-41e5-8a1f-921070f90a77 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:49.020897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce64cb-1195-4be1-bb7c-798743a6e25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:49.022184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce64cb-1195-4be1-bb7c-798743a6e25b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:49.022464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce64cb-1195-4be1-bb7c-798743a6e25b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:49.022722 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce64cb-1195-4be1-bb7c-798743a6e25b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:49.028336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e38b9a-2be4-4a36-8a2a-ca3bb26260e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:49.028948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e38b9a-2be4-4a36-8a2a-ca3bb26260e8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:49.029269 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e38b9a-2be4-4a36-8a2a-ca3bb26260e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:49.029542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e38b9a-2be4-4a36-8a2a-ca3bb26260e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:49.030216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e38b9a-2be4-4a36-8a2a-ca3bb26260e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:55:49.030517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e38b9a-2be4-4a36-8a2a-ca3bb26260e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:49.031915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e38b9a-2be4-4a36-8a2a-ca3bb26260e8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:49.043497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 8/15] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:55:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:49.049253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e38b9a-2be4-4a36-8a2a-ca3bb26260e8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:49.088380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce64cb-1195-4be1-bb7c-798743a6e25b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:49.089949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce64cb-1195-4be1-bb7c-798743a6e25b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:49.147797 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e38b9a-2be4-4a36-8a2a-ca3bb26260e8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:49.182112 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06382661-3bf1-4ede-a073-a651fd313cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:49.182758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06382661-3bf1-4ede-a073-a651fd313cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:49.183035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06382661-3bf1-4ede-a073-a651fd313cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:49.183291 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06382661-3bf1-4ede-a073-a651fd313cd9 None admin] PATH_INFO: `/v3/users/a0f31da57ad743c8a3b7c701031f1af9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:49.184446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06382661-3bf1-4ede-a073-a651fd313cd9 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f31da57ad743c8a3b7c701031f1af9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:49.185943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06382661-3bf1-4ede-a073-a651fd313cd9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:49.187540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 9/16] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:55:49 2022] GET /identity/v3/users/a0f31da57ad743c8a3b7c701031f1af9 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:55:49.189054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 8/17] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:55:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:55:49.193028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06382661-3bf1-4ede-a073-a651fd313cd9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:49.194716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce64cb-1195-4be1-bb7c-798743a6e25b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:49.197451 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:49.208806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:49.290825 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06382661-3bf1-4ede-a073-a651fd313cd9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:49.291095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce64cb-1195-4be1-bb7c-798743a6e25b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:49.324067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64343084-e7e6-4f4c-a14d-1d39d5cfebae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:49.324930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343084-e7e6-4f4c-a14d-1d39d5cfebae None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:49.325240 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343084-e7e6-4f4c-a14d-1d39d5cfebae None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:49.325510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343084-e7e6-4f4c-a14d-1d39d5cfebae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:49.326333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa4a5-f4e5-45b4-ac0d-f2fc206920f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:49.326963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa4a5-f4e5-45b4-ac0d-f2fc206920f7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:49.327241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa4a5-f4e5-45b4-ac0d-f2fc206920f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:49.327512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa4a5-f4e5-45b4-ac0d-f2fc206920f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:49.328666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa4a5-f4e5-45b4-ac0d-f2fc206920f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:49.330151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa4a5-f4e5-45b4-ac0d-f2fc206920f7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:49.331679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 10/18] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:55:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:49.337722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa4a5-f4e5-45b4-ac0d-f2fc206920f7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:49.344372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64343084-e7e6-4f4c-a14d-1d39d5cfebae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:49.345891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64343084-e7e6-4f4c-a14d-1d39d5cfebae None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-64343084-e7e6-4f4c-a14d-1d39d5cfebae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:55:49.363909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:55:49.365255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:55:49.366157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:55:49.366157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:55:49.366157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:55:49.366157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 9/19] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:55:49.371095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64343084-e7e6-4f4c-a14d-1d39d5cfebae None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:49.418557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:49.429801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:49.437855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa4a5-f4e5-45b4-ac0d-f2fc206920f7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:49.472433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e8dbf-0ff4-44fe-9438-31a90f051048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:49.473059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e8dbf-0ff4-44fe-9438-31a90f051048 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:49.473350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e8dbf-0ff4-44fe-9438-31a90f051048 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:49.473622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e8dbf-0ff4-44fe-9438-31a90f051048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:49.474352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e8dbf-0ff4-44fe-9438-31a90f051048 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.domain.id=default, user.id=a0f31da57ad743c8a3b7c701031f1af9) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:55:49.474655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e8dbf-0ff4-44fe-9438-31a90f051048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:49.474855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64343084-e7e6-4f4c-a14d-1d39d5cfebae None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:49.476127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e8dbf-0ff4-44fe-9438-31a90f051048 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:49.482844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 11/20] 10.222.0.76 () {56 vars in 1322 bytes} [Mon Sep 19 16:55:49 2022] GET /identity/v3/role_assignments?user.id=a0f31da57ad743c8a3b7c701031f1af9&scope.domain.id=default&role.id=77285ef607e34662b6234656fe8043d0 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:55:49.510123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6248ef-5e03-42ba-84ee-fb4f423e36cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:49.510771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6248ef-5e03-42ba-84ee-fb4f423e36cb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:49.511051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6248ef-5e03-42ba-84ee-fb4f423e36cb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:49.511329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6248ef-5e03-42ba-84ee-fb4f423e36cb None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:49.512008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6248ef-5e03-42ba-84ee-fb4f423e36cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:55:49.512316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6248ef-5e03-42ba-84ee-fb4f423e36cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:49.513839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6248ef-5e03-42ba-84ee-fb4f423e36cb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:49.533730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 10/21] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:55:51.729593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235a9eb-cc03-436f-9f12-842add9a2e42 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:51.730140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235a9eb-cc03-436f-9f12-842add9a2e42 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:51.730140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235a9eb-cc03-436f-9f12-842add9a2e42 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:51.731644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 12/22] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:51.736896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a70d9-65bc-4349-834d-83b97c87c854 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:51.737329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a70d9-65bc-4349-834d-83b97c87c854 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:51.737513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a70d9-65bc-4349-834d-83b97c87c854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:51.760384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-be2a70d9-65bc-4349-834d-83b97c87c854 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:51.761627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-be2a70d9-65bc-4349-834d-83b97c87c854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:51.855354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 11/23] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:55:52.262218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1655420-850a-4b8f-a277-5915e13002ec None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:52.262589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1655420-850a-4b8f-a277-5915e13002ec None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:52.262758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1655420-850a-4b8f-a277-5915e13002ec None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:52.264134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:52.270096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b0d61-3b3b-4e96-9938-53077285f58d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:52.270726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b0d61-3b3b-4e96-9938-53077285f58d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:52.271575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b0d61-3b3b-4e96-9938-53077285f58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:52.294079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-486b0d61-3b3b-4e96-9938-53077285f58d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:52.295629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-486b0d61-3b3b-4e96-9938-53077285f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:52.350998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:52.383975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1655420-850a-4b8f-a277-5915e13002ec None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:52.405546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 12/25] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:55:52.491081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9aeb-1d17-416e-8175-8d00f9ecf67b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:52.491726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9aeb-1d17-416e-8175-8d00f9ecf67b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:52.492187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c9aeb-1d17-416e-8175-8d00f9ecf67b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:52.493792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 13/26] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:55:52.499065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480d8c-5980-4b27-9791-6ab24cb2f019 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:52.499579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480d8c-5980-4b27-9791-6ab24cb2f019 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:52.500060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46480d8c-5980-4b27-9791-6ab24cb2f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:52.521738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-46480d8c-5980-4b27-9791-6ab24cb2f019 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:52.523818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-46480d8c-5980-4b27-9791-6ab24cb2f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:52.529153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1655420-850a-4b8f-a277-5915e13002ec None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:52.595237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5a0d6-44da-4c4d-924d-d91f30b5bcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:52.596241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5a0d6-44da-4c4d-924d-d91f30b5bcdb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:52.596706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5a0d6-44da-4c4d-924d-d91f30b5bcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:52.597205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5a0d6-44da-4c4d-924d-d91f30b5bcdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:52.616522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5a0d6-44da-4c4d-924d-d91f30b5bcdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4cb5a0d6-44da-4c4d-924d-d91f30b5bcdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:55:52.622852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:55:52.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:55:52.624389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:55:52.630018 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 14/27] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:55:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:55:52.632450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf65e-34ae-426f-ba9e-afeaefa1228c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:52.633902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 14/28] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:55:52.634438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf65e-34ae-426f-ba9e-afeaefa1228c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:52.634915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf65e-34ae-426f-ba9e-afeaefa1228c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:52.636427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46480d8c-5980-4b27-9791-6ab24cb2f019 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:52.637977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 15/29] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:52.649216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa8ea-c944-43ac-a2dd-47e967d55475 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:52.649741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa8ea-c944-43ac-a2dd-47e967d55475 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:52.650201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fa8ea-c944-43ac-a2dd-47e967d55475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:52.668453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:52.685355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-052fa8ea-c944-43ac-a2dd-47e967d55475 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:52.686733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-052fa8ea-c944-43ac-a2dd-47e967d55475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:52.799858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 16/30] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:55:52.800706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fa8ea-c944-43ac-a2dd-47e967d55475 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:52.853494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46480d8c-5980-4b27-9791-6ab24cb2f019 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:52.866155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:52.902742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fa8ea-c944-43ac-a2dd-47e967d55475 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:52.918129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107afae0-5dfb-4979-9363-3c0420c01935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:52.918820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107afae0-5dfb-4979-9363-3c0420c01935 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:52.919052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107afae0-5dfb-4979-9363-3c0420c01935 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:52.919334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107afae0-5dfb-4979-9363-3c0420c01935 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:52.920012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107afae0-5dfb-4979-9363-3c0420c01935 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:55:52.920318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107afae0-5dfb-4979-9363-3c0420c01935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:52.921776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107afae0-5dfb-4979-9363-3c0420c01935 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:52.938469 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74526376-b3fb-48fc-ab6b-c1f5610834f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:52.939097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74526376-b3fb-48fc-ab6b-c1f5610834f6 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:52.939376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74526376-b3fb-48fc-ab6b-c1f5610834f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:52.939649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74526376-b3fb-48fc-ab6b-c1f5610834f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:52.940375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74526376-b3fb-48fc-ab6b-c1f5610834f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:52.941782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74526376-b3fb-48fc-ab6b-c1f5610834f6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:52.945525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:52.948339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 15/31] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:55:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:55:52.956102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107afae0-5dfb-4979-9363-3c0420c01935 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:53.103870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107afae0-5dfb-4979-9363-3c0420c01935 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:53.105410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 17/32] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Sep 19 16:55:52 2022] POST /identity/v3/roles => generated 219 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:55:53.106412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74526376-b3fb-48fc-ab6b-c1f5610834f6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:53.174664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39164edc-c2e0-4123-8fc0-640bd397d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:53.175256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164edc-c2e0-4123-8fc0-640bd397d8db None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:53.175541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164edc-c2e0-4123-8fc0-640bd397d8db None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:53.175835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164edc-c2e0-4123-8fc0-640bd397d8db None admin] PATH_INFO: `/v3/users/a0f31da57ad743c8a3b7c701031f1af9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:53.182276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39164edc-c2e0-4123-8fc0-640bd397d8db None admin] RBAC: Authorizing `identity:get_user(user_id=a0f31da57ad743c8a3b7c701031f1af9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:53.183770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39164edc-c2e0-4123-8fc0-640bd397d8db None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:53.185519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 16/33] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:55:52 2022] GET /identity/v3/users/a0f31da57ad743c8a3b7c701031f1af9 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:55:53.186299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39164edc-c2e0-4123-8fc0-640bd397d8db None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:53.247119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:53.302722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74526376-b3fb-48fc-ab6b-c1f5610834f6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:53.361882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c51c-b2d8-4ccb-9bb2-28a2c635c1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:53.363400 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c51c-b2d8-4ccb-9bb2-28a2c635c1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:53.363690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c51c-b2d8-4ccb-9bb2-28a2c635c1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:53.363971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c51c-b2d8-4ccb-9bb2-28a2c635c1f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:53.370223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39164edc-c2e0-4123-8fc0-640bd397d8db None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:53.377252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5c51c-b2d8-4ccb-9bb2-28a2c635c1f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:53.380963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5c51c-b2d8-4ccb-9bb2-28a2c635c1f8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f5c5c51c-b2d8-4ccb-9bb2-28a2c635c1f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:55:53.398021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:55:53.398903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:55:53.399706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:55:53.399706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:55:53.399706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:55:53.399706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 18/34] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:55:53.405234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c51c-b2d8-4ccb-9bb2-28a2c635c1f8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:53.424278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b979fc-31b5-4039-ab51-106aa1561989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:53.425352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b979fc-31b5-4039-ab51-106aa1561989 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:53.425944 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b979fc-31b5-4039-ab51-106aa1561989 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:53.426400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b979fc-31b5-4039-ab51-106aa1561989 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:53.427258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b979fc-31b5-4039-ab51-106aa1561989 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:53.428883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b979fc-31b5-4039-ab51-106aa1561989 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:53.457459 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:53.522709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c51c-b2d8-4ccb-9bb2-28a2c635c1f8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:53.555598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29079f-0dd1-4139-9db1-d94d0c569af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:53.556240 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29079f-0dd1-4139-9db1-d94d0c569af7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:53.556518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29079f-0dd1-4139-9db1-d94d0c569af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:53.556790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29079f-0dd1-4139-9db1-d94d0c569af7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:53.557938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29079f-0dd1-4139-9db1-d94d0c569af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:53.559449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29079f-0dd1-4139-9db1-d94d0c569af7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:53.566160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 19/35] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:53.567103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29079f-0dd1-4139-9db1-d94d0c569af7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:53.597280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 17/36] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Sep 19 16:55:53 2022] POST /identity/v3/roles => generated 225 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:55:53.598918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b979fc-31b5-4039-ab51-106aa1561989 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:53.728204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:53.735616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b979fc-31b5-4039-ab51-106aa1561989 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:53.761442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29079f-0dd1-4139-9db1-d94d0c569af7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:53.778380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:53.785884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67753c-db02-4782-87e5-80d9252e1dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:53.786985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67753c-db02-4782-87e5-80d9252e1dcf None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:53.788147 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67753c-db02-4782-87e5-80d9252e1dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:53.788623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67753c-db02-4782-87e5-80d9252e1dcf None admin] PATH_INFO: `/v3/domains/default/users/a0f31da57ad743c8a3b7c701031f1af9/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:53.792334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67753c-db02-4782-87e5-80d9252e1dcf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a0f31da57ad743c8a3b7c701031f1af9, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:53.794606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67753c-db02-4782-87e5-80d9252e1dcf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:53.805777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2eb46-44cd-486e-9841-b906d11c1bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:53.806528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2eb46-44cd-486e-9841-b906d11c1bdf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:53.806990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2eb46-44cd-486e-9841-b906d11c1bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:53.807413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2eb46-44cd-486e-9841-b906d11c1bdf None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:53.808516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2eb46-44cd-486e-9841-b906d11c1bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:55:53.808996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2eb46-44cd-486e-9841-b906d11c1bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:53.811209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2eb46-44cd-486e-9841-b906d11c1bdf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:53.823006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 18/37] 10.222.0.76 () {58 vars in 1361 bytes} [Mon Sep 19 16:55:53 2022] PUT /identity/v3/domains/default/users/a0f31da57ad743c8a3b7c701031f1af9/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:55:53.826177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504140f3-7144-4ef0-a915-b5a63893f286 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:53.826664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504140f3-7144-4ef0-a915-b5a63893f286 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:53.827272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504140f3-7144-4ef0-a915-b5a63893f286 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:53.828899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 19/38] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:53.836970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edb2d0-73e5-4ebb-9d37-64287943905d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:53.837527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edb2d0-73e5-4ebb-9d37-64287943905d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:53.837798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edb2d0-73e5-4ebb-9d37-64287943905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:53.841779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 20/39] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:53.847657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2eb46-44cd-486e-9841-b906d11c1bdf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:53.863254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-36edb2d0-73e5-4ebb-9d37-64287943905d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:53.865345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-36edb2d0-73e5-4ebb-9d37-64287943905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:53.978536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 20/40] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:55:53.991139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2eb46-44cd-486e-9841-b906d11c1bdf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:54.029308 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89df5d-0cdc-4d3d-9c53-966f0ae027dc None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:54.029619 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89df5d-0cdc-4d3d-9c53-966f0ae027dc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:54.029873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89df5d-0cdc-4d3d-9c53-966f0ae027dc None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:54.031127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351d909-a5f6-45ee-976d-1c9f61905f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:54.031560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 21/41] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:54.032296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351d909-a5f6-45ee-976d-1c9f61905f40 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:54.032816 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351d909-a5f6-45ee-976d-1c9f61905f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:54.033376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351d909-a5f6-45ee-976d-1c9f61905f40 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:54.034351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351d909-a5f6-45ee-976d-1c9f61905f40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:54.036199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351d909-a5f6-45ee-976d-1c9f61905f40 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:54.037363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca15031-2c4d-4dfa-b6e1-17f9497026e8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:54.037711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca15031-2c4d-4dfa-b6e1-17f9497026e8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:54.037992 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca15031-2c4d-4dfa-b6e1-17f9497026e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:54.059238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8ca15031-2c4d-4dfa-b6e1-17f9497026e8 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:54.060458 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8ca15031-2c4d-4dfa-b6e1-17f9497026e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:54.081895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 21/42] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:55:53 2022] POST /identity/v3/projects => generated 301 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:55:54.160597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 22/43] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:55:54.259458 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351d909-a5f6-45ee-976d-1c9f61905f40 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:54.295213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:54.446135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca15031-2c4d-4dfa-b6e1-17f9497026e8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:54.465986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:54.488354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351d909-a5f6-45ee-976d-1c9f61905f40 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:54.524837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a40b07-0fb5-464d-acce-4e3be59b9864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:54.525369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a40b07-0fb5-464d-acce-4e3be59b9864 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:54.525655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a40b07-0fb5-464d-acce-4e3be59b9864 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:54.525932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a40b07-0fb5-464d-acce-4e3be59b9864 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:54.526599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a40b07-0fb5-464d-acce-4e3be59b9864 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:54.527986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a40b07-0fb5-464d-acce-4e3be59b9864 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:54.544342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 22/44] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Sep 19 16:55:54 2022] POST /identity/v3/roles => generated 223 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:55:54.554960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca15031-2c4d-4dfa-b6e1-17f9497026e8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:54.594602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20f5d4-dd38-44c0-8e65-4199c0085793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:54.595654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f5d4-dd38-44c0-8e65-4199c0085793 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:54.596137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f5d4-dd38-44c0-8e65-4199c0085793 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:54.596609 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f5d4-dd38-44c0-8e65-4199c0085793 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:54.598167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20f5d4-dd38-44c0-8e65-4199c0085793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:54.600091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20f5d4-dd38-44c0-8e65-4199c0085793 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:54.602149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 23/45] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:55:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:55:54.608192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a40b07-0fb5-464d-acce-4e3be59b9864 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:54.721089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:54.739080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a40b07-0fb5-464d-acce-4e3be59b9864 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:54.774421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5766-b327-49ef-9a1b-5a30a04b31dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:54.775118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5766-b327-49ef-9a1b-5a30a04b31dd None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:54.775342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5766-b327-49ef-9a1b-5a30a04b31dd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:54.775706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5766-b327-49ef-9a1b-5a30a04b31dd None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:54.776375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5766-b327-49ef-9a1b-5a30a04b31dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:54.777882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5766-b327-49ef-9a1b-5a30a04b31dd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:54.804985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 23/46] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:55:54 2022] POST /identity/v3/projects => generated 312 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:55:56.108294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f9fec-1f15-4eff-a655-47bfc4dbfd2a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:56.108841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f9fec-1f15-4eff-a655-47bfc4dbfd2a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:56.108841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f9fec-1f15-4eff-a655-47bfc4dbfd2a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:56.110260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 24/47] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:56.115628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd3289-df62-4bbe-ba59-a5cf3fbcfae6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:56.116127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd3289-df62-4bbe-ba59-a5cf3fbcfae6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:56.116218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd3289-df62-4bbe-ba59-a5cf3fbcfae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:56.134744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-adfd3289-df62-4bbe-ba59-a5cf3fbcfae6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:56.136259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-adfd3289-df62-4bbe-ba59-a5cf3fbcfae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:56.206194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 24/48] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:55:56.471483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f9fec-1f15-4eff-a655-47bfc4dbfd2a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:56.562182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:56.579825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f9fec-1f15-4eff-a655-47bfc4dbfd2a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:56.615508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ef0b6-7e0c-4531-8f28-a451360f702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:56.616171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ef0b6-7e0c-4531-8f28-a451360f702a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:56.616452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ef0b6-7e0c-4531-8f28-a451360f702a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:56.616721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ef0b6-7e0c-4531-8f28-a451360f702a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:56.628966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ef0b6-7e0c-4531-8f28-a451360f702a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-990ef0b6-7e0c-4531-8f28-a451360f702a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:55:56.636877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:55:56.637981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:55:56.639339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 25/49] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:55:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:55:56.644305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd3289-df62-4bbe-ba59-a5cf3fbcfae6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:56.718798 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:56.754405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd3289-df62-4bbe-ba59-a5cf3fbcfae6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:56.789466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284c443-8958-4fe4-92f3-cdfcbfff34f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:56.790086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284c443-8958-4fe4-92f3-cdfcbfff34f0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:56.790364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284c443-8958-4fe4-92f3-cdfcbfff34f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:56.790632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284c443-8958-4fe4-92f3-cdfcbfff34f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:56.791301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284c443-8958-4fe4-92f3-cdfcbfff34f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:55:56.791605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284c443-8958-4fe4-92f3-cdfcbfff34f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:56.792993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284c443-8958-4fe4-92f3-cdfcbfff34f0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:56.801282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 25/50] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:55:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:56.807550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ef0b6-7e0c-4531-8f28-a451360f702a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:56.942238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fb4fc-df58-45ee-9726-3cf3669b4b9c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:56.942632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fb4fc-df58-45ee-9726-3cf3669b4b9c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:56.942927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fb4fc-df58-45ee-9726-3cf3669b4b9c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:56.944475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 26/51] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:56.950010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932147-c5b3-4209-bee8-d0ddcc88323f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:56.950286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932147-c5b3-4209-bee8-d0ddcc88323f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:56.950713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18932147-c5b3-4209-bee8-d0ddcc88323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:56.970363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-18932147-c5b3-4209-bee8-d0ddcc88323f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:56.971581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-18932147-c5b3-4209-bee8-d0ddcc88323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:57.022416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ef0b6-7e0c-4531-8f28-a451360f702a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:57.057122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3353b-1113-486c-ba14-c39a4e17368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:57.057756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3353b-1113-486c-ba14-c39a4e17368a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:57.058038 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3353b-1113-486c-ba14-c39a4e17368a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:57.058312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3353b-1113-486c-ba14-c39a4e17368a None admin] PATH_INFO: `/v3/users/a0f31da57ad743c8a3b7c701031f1af9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:57.059237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 27/52] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:55:57.059422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3353b-1113-486c-ba14-c39a4e17368a None admin] RBAC: Authorizing `identity:get_user(user_id=a0f31da57ad743c8a3b7c701031f1af9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:57.060880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3353b-1113-486c-ba14-c39a4e17368a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:57.062505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 26/53] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:55:56 2022] GET /identity/v3/users/a0f31da57ad743c8a3b7c701031f1af9 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:57.067934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932147-c5b3-4209-bee8-d0ddcc88323f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:57.127525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:57.170310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18932147-c5b3-4209-bee8-d0ddcc88323f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:57.203967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dd939-78d2-444b-852f-221f49640c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:57.204601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dd939-78d2-444b-852f-221f49640c8c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:57.204878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dd939-78d2-444b-852f-221f49640c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:57.205172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dd939-78d2-444b-852f-221f49640c8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:57.206318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dd939-78d2-444b-852f-221f49640c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:57.207772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dd939-78d2-444b-852f-221f49640c8c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:57.209373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 28/54] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:55:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:57.215305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3353b-1113-486c-ba14-c39a4e17368a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:57.230892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:57.318660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3353b-1113-486c-ba14-c39a4e17368a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:57.320389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dd939-78d2-444b-852f-221f49640c8c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:57.355297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ebe80-a8a8-4d64-8cec-362e6a3d8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:57.355940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ebe80-a8a8-4d64-8cec-362e6a3d8293 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:57.356228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ebe80-a8a8-4d64-8cec-362e6a3d8293 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:57.356505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ebe80-a8a8-4d64-8cec-362e6a3d8293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:57.357292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ebe80-a8a8-4d64-8cec-362e6a3d8293 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.domain.id=default, user.id=a0f31da57ad743c8a3b7c701031f1af9) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:55:57.357624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ebe80-a8a8-4d64-8cec-362e6a3d8293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:57.359113 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ebe80-a8a8-4d64-8cec-362e6a3d8293 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:57.367509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 27/55] 10.222.0.76 () {56 vars in 1322 bytes} [Mon Sep 19 16:55:57 2022] GET /identity/v3/role_assignments?user.id=a0f31da57ad743c8a3b7c701031f1af9&scope.domain.id=default&role.id=77285ef607e34662b6234656fe8043d0 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:57.432859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dd939-78d2-444b-852f-221f49640c8c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:57.463493 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:57.472907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425eaae-c0ba-49cf-8dd4-490dc169e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:57.473620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425eaae-c0ba-49cf-8dd4-490dc169e714 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:57.473898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425eaae-c0ba-49cf-8dd4-490dc169e714 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:57.474170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425eaae-c0ba-49cf-8dd4-490dc169e714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:57.475411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425eaae-c0ba-49cf-8dd4-490dc169e714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:57.476967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425eaae-c0ba-49cf-8dd4-490dc169e714 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:57.478543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 29/56] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:55:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:55:57.484653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ebe80-a8a8-4d64-8cec-362e6a3d8293 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:55:57.567992 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:55:57.592183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ebe80-a8a8-4d64-8cec-362e6a3d8293 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:55:57.626748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359c47f-163d-43a4-931f-5d5fb1928ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:55:57.627381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c47f-163d-43a4-931f-5d5fb1928ed2 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:57.627662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c47f-163d-43a4-931f-5d5fb1928ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:57.627939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359c47f-163d-43a4-931f-5d5fb1928ed2 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:57.628595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359c47f-163d-43a4-931f-5d5fb1928ed2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:55:57.630092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359c47f-163d-43a4-931f-5d5fb1928ed2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:55:57.658100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 28/57] 10.222.0.76 () {60 vars in 1140 bytes} [Mon Sep 19 16:55:57 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:55:59.775072 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae331c-aaac-4d64-a81a-c4b37b4e6624 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:59.775896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae331c-aaac-4d64-a81a-c4b37b4e6624 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:59.775896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae331c-aaac-4d64-a81a-c4b37b4e6624 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:59.778132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 30/58] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:55:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:55:59.783729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c489870-6d81-48a4-adc4-d554b1efab34 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:55:59.784140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c489870-6d81-48a4-adc4-d554b1efab34 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:55:59.784303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c489870-6d81-48a4-adc4-d554b1efab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:55:59.804868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6c489870-6d81-48a4-adc4-d554b1efab34 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:55:59.806262 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6c489870-6d81-48a4-adc4-d554b1efab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:55:59.875702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 29/59] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:00.138598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae331c-aaac-4d64-a81a-c4b37b4e6624 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:00.258840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae331c-aaac-4d64-a81a-c4b37b4e6624 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:00.297275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd5108-5dc3-499e-9792-88be0630c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:00.297912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd5108-5dc3-499e-9792-88be0630c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:00.298197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd5108-5dc3-499e-9792-88be0630c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:00.298472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd5108-5dc3-499e-9792-88be0630c5c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:00.299708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd5108-5dc3-499e-9792-88be0630c5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:00.301195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd5108-5dc3-499e-9792-88be0630c5c0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:00.302767 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 31/60] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:00.311881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c489870-6d81-48a4-adc4-d554b1efab34 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:00.373822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:00.417698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c489870-6d81-48a4-adc4-d554b1efab34 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:00.453237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eef31b-0556-4681-850d-b5d21699572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:00.453844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eef31b-0556-4681-850d-b5d21699572b None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:00.454137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eef31b-0556-4681-850d-b5d21699572b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:00.454421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eef31b-0556-4681-850d-b5d21699572b None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:00.455077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eef31b-0556-4681-850d-b5d21699572b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:00.456541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eef31b-0556-4681-850d-b5d21699572b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:00.488551 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 30/61] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:56:00 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:56:03.751176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f99c55-1c2b-44ed-9b9c-9bace615a9c6 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:03.751697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f99c55-1c2b-44ed-9b9c-9bace615a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:03.751697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f99c55-1c2b-44ed-9b9c-9bace615a9c6 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:03.753320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 32/62] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:03.759024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94522c64-280b-4171-983c-e20c3a3ce948 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:03.759489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94522c64-280b-4171-983c-e20c3a3ce948 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:03.759561 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94522c64-280b-4171-983c-e20c3a3ce948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:03.782847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-94522c64-280b-4171-983c-e20c3a3ce948 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:03.784104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-94522c64-280b-4171-983c-e20c3a3ce948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:03.886697 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 31/63] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:03.983217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe989-74b5-4731-8d30-bc115b2ffd4a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:03.983217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe989-74b5-4731-8d30-bc115b2ffd4a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:03.983217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebe989-74b5-4731-8d30-bc115b2ffd4a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:03.983217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 33/64] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:03.988706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cdc73-176e-4b18-a36c-4a28e3f9fbc0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:03.989001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cdc73-176e-4b18-a36c-4a28e3f9fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:03.989303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cdc73-176e-4b18-a36c-4a28e3f9fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.013348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-456cdc73-176e-4b18-a36c-4a28e3f9fbc0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:04.014462 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-456cdc73-176e-4b18-a36c-4a28e3f9fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:04.022384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc08a7-7e00-414b-8e3f-c647627a37aa None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.022758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc08a7-7e00-414b-8e3f-c647627a37aa None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.023110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc08a7-7e00-414b-8e3f-c647627a37aa None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.024558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 34/65] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:04.029642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d86c77-d7bb-4602-9a14-8fc788a17b7a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.030001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d86c77-d7bb-4602-9a14-8fc788a17b7a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.030348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d86c77-d7bb-4602-9a14-8fc788a17b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.060947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-10d86c77-d7bb-4602-9a14-8fc788a17b7a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:04.062218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-10d86c77-d7bb-4602-9a14-8fc788a17b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:04.097412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:04.147178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 32/66] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:04.189672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:04.204168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 35/67] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:04.236938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cdc73-176e-4b18-a36c-4a28e3f9fbc0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:04.263564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e951dd-187a-403c-b056-1d70908387e5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.263866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e951dd-187a-403c-b056-1d70908387e5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.264027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e951dd-187a-403c-b056-1d70908387e5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.265425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 36/68] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:04.274103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502233-b3fa-43b3-a601-ad20a8d8becc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.274393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502233-b3fa-43b3-a601-ad20a8d8becc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.274672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502233-b3fa-43b3-a601-ad20a8d8becc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.293236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-01502233-b3fa-43b3-a601-ad20a8d8becc None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:04.294441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-01502233-b3fa-43b3-a601-ad20a8d8becc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:04.398462 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cdc73-176e-4b18-a36c-4a28e3f9fbc0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:04.404430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 37/69] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:04.442371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cdd11-daf9-4517-88e9-80b380f2d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:04.443026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cdd11-daf9-4517-88e9-80b380f2d2eb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.443312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cdd11-daf9-4517-88e9-80b380f2d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.443586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cdd11-daf9-4517-88e9-80b380f2d2eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.454403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cdd11-daf9-4517-88e9-80b380f2d2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-614cdd11-daf9-4517-88e9-80b380f2d2eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:04.459328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:04.460142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:04.460893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 33/70] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:04.466681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01502233-b3fa-43b3-a601-ad20a8d8becc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:04.508739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cdd11-daf9-4517-88e9-80b380f2d2eb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:04.563242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:04.573326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01502233-b3fa-43b3-a601-ad20a8d8becc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:04.598032 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:04.615156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dae16-2270-40f4-b386-298aec7ecd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:04.615849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dae16-2270-40f4-b386-298aec7ecd93 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.616136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dae16-2270-40f4-b386-298aec7ecd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.616413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dae16-2270-40f4-b386-298aec7ecd93 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.617126 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dae16-2270-40f4-b386-298aec7ecd93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:04.617436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dae16-2270-40f4-b386-298aec7ecd93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:04.618852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dae16-2270-40f4-b386-298aec7ecd93 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:04.627191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 38/71] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:04.627983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dae16-2270-40f4-b386-298aec7ecd93 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:04.637499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cdd11-daf9-4517-88e9-80b380f2d2eb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:04.673436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7dc3e-4c04-4d76-957f-6738f7e756e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:04.674370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7dc3e-4c04-4d76-957f-6738f7e756e5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.674901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7dc3e-4c04-4d76-957f-6738f7e756e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.675175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7dc3e-4c04-4d76-957f-6738f7e756e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.685631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7dc3e-4c04-4d76-957f-6738f7e756e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-42a7dc3e-4c04-4d76-957f-6738f7e756e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:04.691266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:04.692084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:04.692831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 34/72] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:56:04.698317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba5127-82a1-42e4-9655-478724dd73bd None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.698606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba5127-82a1-42e4-9655-478724dd73bd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.698883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba5127-82a1-42e4-9655-478724dd73bd None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.700183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 35/73] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:04.700881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba5127-82a1-42e4-9655-478724dd73bd None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:04.733173 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dae16-2270-40f4-b386-298aec7ecd93 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:04.766800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a6aab-3095-476a-a2ad-8bf21693599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:04.767440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a6aab-3095-476a-a2ad-8bf21693599d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.767717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a6aab-3095-476a-a2ad-8bf21693599d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.767993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a6aab-3095-476a-a2ad-8bf21693599d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.778441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a6aab-3095-476a-a2ad-8bf21693599d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d80a6aab-3095-476a-a2ad-8bf21693599d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:04.783719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:04.784716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:04.785709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:04.786917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 39/74] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:56:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:04.787818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a6aab-3095-476a-a2ad-8bf21693599d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:04.806133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:04.813899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba5127-82a1-42e4-9655-478724dd73bd None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:04.833483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:04.847077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d4ca0-297a-4ca0-ace0-ee79ac97f3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:04.847727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4ca0-297a-4ca0-ace0-ee79ac97f3dd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.848018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4ca0-297a-4ca0-ace0-ee79ac97f3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.848299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d4ca0-297a-4ca0-ace0-ee79ac97f3dd None admin] PATH_INFO: `/v3/users/43415b08461749e6b1c27fcc1a6883b6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.863402 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d4ca0-297a-4ca0-ace0-ee79ac97f3dd None admin] RBAC: Authorizing `identity:get_user(user_id=43415b08461749e6b1c27fcc1a6883b6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:04.864937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d4ca0-297a-4ca0-ace0-ee79ac97f3dd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:04.866893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 36/75] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:04 2022] GET /identity/v3/users/43415b08461749e6b1c27fcc1a6883b6 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:04.867817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc0c6-d6c1-44de-bca5-a39cc5f2f3db None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.868106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc0c6-d6c1-44de-bca5-a39cc5f2f3db None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.868386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc0c6-d6c1-44de-bca5-a39cc5f2f3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.886070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b57cc0c6-d6c1-44de-bca5-a39cc5f2f3db None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:04.887272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b57cc0c6-d6c1-44de-bca5-a39cc5f2f3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:04.893249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a6aab-3095-476a-a2ad-8bf21693599d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:04.927158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1d19a-32e1-4a17-997d-7ebe8d2e4ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:04.927796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1d19a-32e1-4a17-997d-7ebe8d2e4ebb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:04.928108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1d19a-32e1-4a17-997d-7ebe8d2e4ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:04.928382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1d19a-32e1-4a17-997d-7ebe8d2e4ebb None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:04.929062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1d19a-32e1-4a17-997d-7ebe8d2e4ebb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:04.929371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1d19a-32e1-4a17-997d-7ebe8d2e4ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:04.930778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1d19a-32e1-4a17-997d-7ebe8d2e4ebb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:04.938644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 40/76] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:04.939438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1d19a-32e1-4a17-997d-7ebe8d2e4ebb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:04.954835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 37/77] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:04.957909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cc0c6-d6c1-44de-bca5-a39cc5f2f3db None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.039072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:05.041062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1d19a-32e1-4a17-997d-7ebe8d2e4ebb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.051613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:05.058599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cc0c6-d6c1-44de-bca5-a39cc5f2f3db None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.081500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a0a65-e55e-45e7-80e9-7fac97c599fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:05.082082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a0a65-e55e-45e7-80e9-7fac97c599fc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:05.082369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a0a65-e55e-45e7-80e9-7fac97c599fc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:05.082648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a0a65-e55e-45e7-80e9-7fac97c599fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:05.092701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a0a65-e55e-45e7-80e9-7fac97c599fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:05.097773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e670079-58b3-4197-add0-90d8ca0212dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c37a0a65-e55e-45e7-80e9-7fac97c599fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:05.097988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:05.098799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:05.099565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:05.100136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e670079-58b3-4197-add0-90d8ca0212dd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:05.100136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e670079-58b3-4197-add0-90d8ca0212dd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:05.100136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e670079-58b3-4197-add0-90d8ca0212dd None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:05.100330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 41/78] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:05.100393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e670079-58b3-4197-add0-90d8ca0212dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:05.100393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e670079-58b3-4197-add0-90d8ca0212dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:05.101472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e670079-58b3-4197-add0-90d8ca0212dd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:05.104647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a0a65-e55e-45e7-80e9-7fac97c599fc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.114983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 38/79] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:05.114983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e670079-58b3-4197-add0-90d8ca0212dd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.228311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a0a65-e55e-45e7-80e9-7fac97c599fc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.234829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e670079-58b3-4197-add0-90d8ca0212dd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.262039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b19c9-200f-4936-b0b5-4cf2d3c8cc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:05.262773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b19c9-200f-4936-b0b5-4cf2d3c8cc89 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:05.263051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b19c9-200f-4936-b0b5-4cf2d3c8cc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:05.263373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b19c9-200f-4936-b0b5-4cf2d3c8cc89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:05.274922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e635a04-728b-4dd1-b683-97702f89ccd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:05.275911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e635a04-728b-4dd1-b683-97702f89ccd6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:05.276198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e635a04-728b-4dd1-b683-97702f89ccd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:05.276485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e635a04-728b-4dd1-b683-97702f89ccd6 None admin] PATH_INFO: `/v3/users/43415b08461749e6b1c27fcc1a6883b6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:05.277784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e635a04-728b-4dd1-b683-97702f89ccd6 None admin] RBAC: Authorizing `identity:get_user(user_id=43415b08461749e6b1c27fcc1a6883b6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:05.279257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e635a04-728b-4dd1-b683-97702f89ccd6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:05.280967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 39/80] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:05 2022] GET /identity/v3/users/43415b08461749e6b1c27fcc1a6883b6 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:05.281879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e635a04-728b-4dd1-b683-97702f89ccd6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.299508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:05.301847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:05.335377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b19c9-200f-4936-b0b5-4cf2d3c8cc89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:05.336849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b19c9-200f-4936-b0b5-4cf2d3c8cc89 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:05.386260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e635a04-728b-4dd1-b683-97702f89ccd6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.423736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918db98e-f8e0-4601-b522-1b03e2da77d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:05.424274 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918db98e-f8e0-4601-b522-1b03e2da77d7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:05.424636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918db98e-f8e0-4601-b522-1b03e2da77d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:05.424978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918db98e-f8e0-4601-b522-1b03e2da77d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:05.425702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918db98e-f8e0-4601-b522-1b03e2da77d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:05.426012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918db98e-f8e0-4601-b522-1b03e2da77d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:05.427634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918db98e-f8e0-4601-b522-1b03e2da77d7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:05.438248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 40/81] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:05.441874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918db98e-f8e0-4601-b522-1b03e2da77d7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.450398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 42/82] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:05.458042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b19c9-200f-4936-b0b5-4cf2d3c8cc89 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.515422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:05.524980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:05.541624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918db98e-f8e0-4601-b522-1b03e2da77d7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.558467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b19c9-200f-4936-b0b5-4cf2d3c8cc89 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.574654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ef073-fc7d-4da3-acfa-8404fdab1706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:05.575299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ef073-fc7d-4da3-acfa-8404fdab1706 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:05.575614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ef073-fc7d-4da3-acfa-8404fdab1706 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:05.575892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ef073-fc7d-4da3-acfa-8404fdab1706 None admin] PATH_INFO: `/v3/users/a0f31da57ad743c8a3b7c701031f1af9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:05.577060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ef073-fc7d-4da3-acfa-8404fdab1706 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f31da57ad743c8a3b7c701031f1af9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:05.578523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ef073-fc7d-4da3-acfa-8404fdab1706 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:05.580117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 41/83] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:05 2022] GET /identity/v3/users/a0f31da57ad743c8a3b7c701031f1af9 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:05.580885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ef073-fc7d-4da3-acfa-8404fdab1706 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.592169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc841f5-ed82-497f-8a82-51b811f89001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:05.592738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc841f5-ed82-497f-8a82-51b811f89001 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:05.593013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc841f5-ed82-497f-8a82-51b811f89001 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:05.593308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc841f5-ed82-497f-8a82-51b811f89001 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:05.594428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc841f5-ed82-497f-8a82-51b811f89001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:05.595874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc841f5-ed82-497f-8a82-51b811f89001 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:05.597502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 43/84] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:05.598255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc841f5-ed82-497f-8a82-51b811f89001 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.678182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ef073-fc7d-4da3-acfa-8404fdab1706 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.699476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc841f5-ed82-497f-8a82-51b811f89001 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.710611 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f3a3c-8877-46d6-97e6-bd4a3672ae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:05.711228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f3a3c-8877-46d6-97e6-bd4a3672ae7e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:05.711513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f3a3c-8877-46d6-97e6-bd4a3672ae7e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:05.711789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f3a3c-8877-46d6-97e6-bd4a3672ae7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:05.723237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:05.732516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931116d6-5eb8-48ed-bf83-a0f860b17f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:05.733180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931116d6-5eb8-48ed-bf83-a0f860b17f50 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:05.733464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931116d6-5eb8-48ed-bf83-a0f860b17f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:05.733736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931116d6-5eb8-48ed-bf83-a0f860b17f50 None admin] PATH_INFO: `/v3/users/43415b08461749e6b1c27fcc1a6883b6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:05.734886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931116d6-5eb8-48ed-bf83-a0f860b17f50 None admin] RBAC: Authorizing `identity:get_user(user_id=43415b08461749e6b1c27fcc1a6883b6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:05.736342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931116d6-5eb8-48ed-bf83-a0f860b17f50 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:05.737976 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 44/85] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:05 2022] GET /identity/v3/users/43415b08461749e6b1c27fcc1a6883b6 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:05.742632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931116d6-5eb8-48ed-bf83-a0f860b17f50 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.742632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:05.780378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f3a3c-8877-46d6-97e6-bd4a3672ae7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:05.781901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f3a3c-8877-46d6-97e6-bd4a3672ae7e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:05.834873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931116d6-5eb8-48ed-bf83-a0f860b17f50 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.867486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346bdb8-d96d-49d1-a2c9-de2a1a107825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:05.868047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346bdb8-d96d-49d1-a2c9-de2a1a107825 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:05.868328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346bdb8-d96d-49d1-a2c9-de2a1a107825 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:05.868604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346bdb8-d96d-49d1-a2c9-de2a1a107825 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:05.869773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346bdb8-d96d-49d1-a2c9-de2a1a107825 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:05.871217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346bdb8-d96d-49d1-a2c9-de2a1a107825 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:05.872876 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 45/86] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:05 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:05.878446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 42/87] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:05.878889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346bdb8-d96d-49d1-a2c9-de2a1a107825 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.879259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f3a3c-8877-46d6-97e6-bd4a3672ae7e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:05.921907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:05.950686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:05.978601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f3a3c-8877-46d6-97e6-bd4a3672ae7e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:05.980849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346bdb8-d96d-49d1-a2c9-de2a1a107825 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:06.011783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f6b74-02ab-4388-8aef-baeae221da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:06.012396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f6b74-02ab-4388-8aef-baeae221da80 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:06.012682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f6b74-02ab-4388-8aef-baeae221da80 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:06.012964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f6b74-02ab-4388-8aef-baeae221da80 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:06.013450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c0a7b-c476-4576-a238-e726617faef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:06.013640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f6b74-02ab-4388-8aef-baeae221da80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:06.014064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c0a7b-c476-4576-a238-e726617faef8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:06.014345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c0a7b-c476-4576-a238-e726617faef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:06.014619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c0a7b-c476-4576-a238-e726617faef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:06.015106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f6b74-02ab-4388-8aef-baeae221da80 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:06.036628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 43/88] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:56:05 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:56:06.037518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f6b74-02ab-4388-8aef-baeae221da80 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:06.099715 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c0a7b-c476-4576-a238-e726617faef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:06.101386 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c0a7b-c476-4576-a238-e726617faef8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:06.157589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:06.161840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f6b74-02ab-4388-8aef-baeae221da80 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:06.185026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:06.202754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e60e6e-d1b6-4256-8253-d2711673515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:06.203547 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e60e6e-d1b6-4256-8253-d2711673515d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:06.203837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e60e6e-d1b6-4256-8253-d2711673515d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:06.204116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e60e6e-d1b6-4256-8253-d2711673515d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:06.226583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 46/89] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:06.226583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c0a7b-c476-4576-a238-e726617faef8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:06.284391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e60e6e-d1b6-4256-8253-d2711673515d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:06.286241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e60e6e-d1b6-4256-8253-d2711673515d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:06.338934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c0a7b-c476-4576-a238-e726617faef8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:06.380459 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e44ea-d794-45d3-a1cc-cb0848e0d102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:06.381257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e44ea-d794-45d3-a1cc-cb0848e0d102 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:06.381543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e44ea-d794-45d3-a1cc-cb0848e0d102 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:06.381822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e44ea-d794-45d3-a1cc-cb0848e0d102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:06.382677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e44ea-d794-45d3-a1cc-cb0848e0d102 None admin] RBAC: Adding query filter params (role.id=b86a73fa9cc046eeae600bffd4218e7b, scope.project.id=cd13a123c9a040d092492aaa25e0225e, user.id=43415b08461749e6b1c27fcc1a6883b6) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:06.382998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e44ea-d794-45d3-a1cc-cb0848e0d102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:06.384480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e44ea-d794-45d3-a1cc-cb0848e0d102 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:06.393912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 47/90] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:06 2022] GET /identity/v3/role_assignments?user.id=43415b08461749e6b1c27fcc1a6883b6&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:06.394610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e44ea-d794-45d3-a1cc-cb0848e0d102 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:06.411963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 44/91] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:06.417148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e60e6e-d1b6-4256-8253-d2711673515d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:06.417500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:06.443690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:06.529187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e44ea-d794-45d3-a1cc-cb0848e0d102 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:06.576700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e60e6e-d1b6-4256-8253-d2711673515d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:06.600497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe382f-6ef7-4258-a4a8-21f1afbb83c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:06.601511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe382f-6ef7-4258-a4a8-21f1afbb83c7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:06.601984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe382f-6ef7-4258-a4a8-21f1afbb83c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:06.603847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe382f-6ef7-4258-a4a8-21f1afbb83c7 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:06.606897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe382f-6ef7-4258-a4a8-21f1afbb83c7 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:06.609685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe382f-6ef7-4258-a4a8-21f1afbb83c7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:06.611680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 48/92] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:06 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:06.615633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe382f-6ef7-4258-a4a8-21f1afbb83c7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:06.637147 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff281119-b003-4b66-9bb6-4b4d37d8873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:06.638117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff281119-b003-4b66-9bb6-4b4d37d8873d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:06.638688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff281119-b003-4b66-9bb6-4b4d37d8873d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:06.639222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff281119-b003-4b66-9bb6-4b4d37d8873d None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:06.640556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff281119-b003-4b66-9bb6-4b4d37d8873d None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:06.642367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff281119-b003-4b66-9bb6-4b4d37d8873d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:06.645455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 45/93] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:06 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:06.646933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff281119-b003-4b66-9bb6-4b4d37d8873d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:06.723195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe382f-6ef7-4258-a4a8-21f1afbb83c7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:06.725615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:06.757375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:06.759224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f675b-9fce-492c-920b-006fd838c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:06.759879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f675b-9fce-492c-920b-006fd838c87e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:06.760163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f675b-9fce-492c-920b-006fd838c87e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:06.760442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f675b-9fce-492c-920b-006fd838c87e None admin] PATH_INFO: `/v3/projects/234140f91d7a41688962319cf3103ed5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:06.761648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f675b-9fce-492c-920b-006fd838c87e None admin] RBAC: Authorizing `identity:get_project(project_id=234140f91d7a41688962319cf3103ed5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:06.763113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f675b-9fce-492c-920b-006fd838c87e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:06.765061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 49/94] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:06 2022] GET /identity/v3/projects/234140f91d7a41688962319cf3103ed5 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:06.765583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f675b-9fce-492c-920b-006fd838c87e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:06.823380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff281119-b003-4b66-9bb6-4b4d37d8873d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:06.874832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f675b-9fce-492c-920b-006fd838c87e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:06.890517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ee391-dd8d-441d-ac66-75b7839e3a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:06.891244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ee391-dd8d-441d-ac66-75b7839e3a78 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:06.891539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ee391-dd8d-441d-ac66-75b7839e3a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:06.891819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ee391-dd8d-441d-ac66-75b7839e3a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:06.892572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ee391-dd8d-441d-ac66-75b7839e3a78 None admin] RBAC: Adding query filter params (role.id=ee6045909540420b8b406a308fdad516, scope.project.id=cd13a123c9a040d092492aaa25e0225e, user.id=43415b08461749e6b1c27fcc1a6883b6) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:06.892884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ee391-dd8d-441d-ac66-75b7839e3a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:06.894594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ee391-dd8d-441d-ac66-75b7839e3a78 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:06.914324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 46/95] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:06 2022] GET /identity/v3/role_assignments?user.id=43415b08461749e6b1c27fcc1a6883b6&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=ee6045909540420b8b406a308fdad516 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:06.915125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ee391-dd8d-441d-ac66-75b7839e3a78 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:06.937224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c4c7c-fc86-4414-80e0-cc0ff59b99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:06.937873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c4c7c-fc86-4414-80e0-cc0ff59b99a9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:06.938161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c4c7c-fc86-4414-80e0-cc0ff59b99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:06.938435 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c4c7c-fc86-4414-80e0-cc0ff59b99a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:06.939205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c4c7c-fc86-4414-80e0-cc0ff59b99a9 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=cd13a123c9a040d092492aaa25e0225e, user.id=a0f31da57ad743c8a3b7c701031f1af9) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:06.939521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c4c7c-fc86-4414-80e0-cc0ff59b99a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:06.941009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c4c7c-fc86-4414-80e0-cc0ff59b99a9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:06.953218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 50/96] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:06 2022] GET /identity/v3/role_assignments?user.id=a0f31da57ad743c8a3b7c701031f1af9&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=77285ef607e34662b6234656fe8043d0 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:07.073797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ee391-dd8d-441d-ac66-75b7839e3a78 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:07.107166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:07.113595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015d07a-ea15-4886-b1aa-5c124242dd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:07.114249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015d07a-ea15-4886-b1aa-5c124242dd58 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:07.114530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015d07a-ea15-4886-b1aa-5c124242dd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:07.114809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015d07a-ea15-4886-b1aa-5c124242dd58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:07.115610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015d07a-ea15-4886-b1aa-5c124242dd58 None admin] RBAC: Adding query filter params (role.id=b86a73fa9cc046eeae600bffd4218e7b, scope.project.id=234140f91d7a41688962319cf3103ed5, user.id=43415b08461749e6b1c27fcc1a6883b6) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:07.116014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015d07a-ea15-4886-b1aa-5c124242dd58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:07.117543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015d07a-ea15-4886-b1aa-5c124242dd58 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:07.124021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 47/97] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:06 2022] GET /identity/v3/role_assignments?user.id=43415b08461749e6b1c27fcc1a6883b6&scope.project.id=234140f91d7a41688962319cf3103ed5&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:08.800438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad95ba-e9d3-4543-bc66-76c7c27147d3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:08.800989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad95ba-e9d3-4543-bc66-76c7c27147d3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:08.801086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad95ba-e9d3-4543-bc66-76c7c27147d3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:08.802463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 51/98] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:08.807883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaebd1-2652-4945-9d19-c15d8d6a46ea None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:08.808291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaebd1-2652-4945-9d19-c15d8d6a46ea None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:08.808492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaebd1-2652-4945-9d19-c15d8d6a46ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:08.827712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6bdaebd1-2652-4945-9d19-c15d8d6a46ea None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:08.828915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6bdaebd1-2652-4945-9d19-c15d8d6a46ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:08.918631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 48/99] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:09.300132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516558e0-b4ae-4beb-9834-bb51f25f8f96 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:09.300507 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516558e0-b4ae-4beb-9834-bb51f25f8f96 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:09.300678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516558e0-b4ae-4beb-9834-bb51f25f8f96 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:09.302072 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 52/100] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:09.307503 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278db93-23a2-4fc8-b44a-61e1db1cebfe None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:09.307799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278db93-23a2-4fc8-b44a-61e1db1cebfe None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:09.308074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278db93-23a2-4fc8-b44a-61e1db1cebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:09.334036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2278db93-23a2-4fc8-b44a-61e1db1cebfe None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:09.335318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2278db93-23a2-4fc8-b44a-61e1db1cebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:09.422668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 49/101] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:09.489818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516558e0-b4ae-4beb-9834-bb51f25f8f96 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:09.533669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:09.623486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516558e0-b4ae-4beb-9834-bb51f25f8f96 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:09.671762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389dd24-7faa-449d-84e8-0a64627b893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:09.672418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389dd24-7faa-449d-84e8-0a64627b893c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:09.672757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389dd24-7faa-449d-84e8-0a64627b893c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:09.672978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389dd24-7faa-449d-84e8-0a64627b893c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:09.690304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389dd24-7faa-449d-84e8-0a64627b893c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6389dd24-7faa-449d-84e8-0a64627b893c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:09.695868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:09.696747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:09.697536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 53/102] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:09.703294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278db93-23a2-4fc8-b44a-61e1db1cebfe None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:09.753312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389dd24-7faa-449d-84e8-0a64627b893c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:09.828248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:09.909299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278db93-23a2-4fc8-b44a-61e1db1cebfe None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:09.963333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:09.969380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7edef-6dfb-44a5-a540-a8c20c93203d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:09.970311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7edef-6dfb-44a5-a540-a8c20c93203d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:09.970690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7edef-6dfb-44a5-a540-a8c20c93203d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:09.971251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7edef-6dfb-44a5-a540-a8c20c93203d None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:09.972005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7edef-6dfb-44a5-a540-a8c20c93203d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:09.972379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7edef-6dfb-44a5-a540-a8c20c93203d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:09.974485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7edef-6dfb-44a5-a540-a8c20c93203d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:09.977369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389dd24-7faa-449d-84e8-0a64627b893c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:09.992108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 50/103] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:09.997614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7edef-6dfb-44a5-a540-a8c20c93203d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:10.060918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c04cd-da7e-4c25-ad1b-faff16f5dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:10.061882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c04cd-da7e-4c25-ad1b-faff16f5dc12 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.062293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c04cd-da7e-4c25-ad1b-faff16f5dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.062689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c04cd-da7e-4c25-ad1b-faff16f5dc12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.064506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c04cd-da7e-4c25-ad1b-faff16f5dc12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:10.068332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c04cd-da7e-4c25-ad1b-faff16f5dc12 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:10.068332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 54/104] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:10.074003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201c731-5741-4a62-9bfe-de84c3a4e9e0 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.074370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201c731-5741-4a62-9bfe-de84c3a4e9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.074659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201c731-5741-4a62-9bfe-de84c3a4e9e0 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.075930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 55/105] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:10.077158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8789e57-1828-4c1e-b056-6c69df6adfc8 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.077488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8789e57-1828-4c1e-b056-6c69df6adfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.077820 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8789e57-1828-4c1e-b056-6c69df6adfc8 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.079161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 56/106] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:10.080556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8789e57-1828-4c1e-b056-6c69df6adfc8 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:10.153710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7edef-6dfb-44a5-a540-a8c20c93203d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:10.172065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:10.191654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6b9f7-bd6a-415e-b090-bab63d49deb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:10.192408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b9f7-bd6a-415e-b090-bab63d49deb3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.192583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b9f7-bd6a-415e-b090-bab63d49deb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.192863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b9f7-bd6a-415e-b090-bab63d49deb3 None admin] PATH_INFO: `/v3/users/dbc5534d5cbe43a889cef7d5614775a9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.206619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8789e57-1828-4c1e-b056-6c69df6adfc8 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:10.208467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6b9f7-bd6a-415e-b090-bab63d49deb3 None admin] RBAC: Authorizing `identity:get_user(user_id=dbc5534d5cbe43a889cef7d5614775a9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:10.210186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6b9f7-bd6a-415e-b090-bab63d49deb3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:10.211792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 51/107] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:09 2022] GET /identity/v3/users/dbc5534d5cbe43a889cef7d5614775a9 => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:10.212994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ebe6e-28e9-4bb3-b936-bf8c2ab02e90 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.213324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ebe6e-28e9-4bb3-b936-bf8c2ab02e90 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.213656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ebe6e-28e9-4bb3-b936-bf8c2ab02e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.232354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b75ebe6e-28e9-4bb3-b936-bf8c2ab02e90 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:10.233757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b75ebe6e-28e9-4bb3-b936-bf8c2ab02e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:10.244976 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380be3e-a206-4531-bb00-c660e7f697d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:10.245626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380be3e-a206-4531-bb00-c660e7f697d2 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.245906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380be3e-a206-4531-bb00-c660e7f697d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.246176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380be3e-a206-4531-bb00-c660e7f697d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.246873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380be3e-a206-4531-bb00-c660e7f697d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:10.248279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380be3e-a206-4531-bb00-c660e7f697d2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:10.277095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 57/108] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:56:10 2022] POST /identity/v3/projects => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:56:10.278426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedeb552-1949-46f8-b0ca-30de2c722562 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.278716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedeb552-1949-46f8-b0ca-30de2c722562 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.278996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedeb552-1949-46f8-b0ca-30de2c722562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.300864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dedeb552-1949-46f8-b0ca-30de2c722562 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:10.302860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dedeb552-1949-46f8-b0ca-30de2c722562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:10.319428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:10.330264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 52/109] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:10.331632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ebe6e-28e9-4bb3-b936-bf8c2ab02e90 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:10.418317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 58/110] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:10.420133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87691d-6679-4310-9e85-79258de22400 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.420618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87691d-6679-4310-9e85-79258de22400 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.421214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87691d-6679-4310-9e85-79258de22400 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.423038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 59/111] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:10.429230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31026af-fb85-4fd4-9ade-56446a670982 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.429932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31026af-fb85-4fd4-9ade-56446a670982 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.430399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31026af-fb85-4fd4-9ade-56446a670982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.450412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f31026af-fb85-4fd4-9ade-56446a670982 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:10.452176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f31026af-fb85-4fd4-9ade-56446a670982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:10.535283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ebe6e-28e9-4bb3-b936-bf8c2ab02e90 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:10.538275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:10.553232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 60/112] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:10.554939 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afedf3-2981-4f87-909d-f3a3387b47fd None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.555412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afedf3-2981-4f87-909d-f3a3387b47fd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.555893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afedf3-2981-4f87-909d-f3a3387b47fd None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.557653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 61/113] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:10.563471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626bf7b-104f-4e2c-9512-2dbc8b17e8aa None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.563966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626bf7b-104f-4e2c-9512-2dbc8b17e8aa None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.564445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626bf7b-104f-4e2c-9512-2dbc8b17e8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.587575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9626bf7b-104f-4e2c-9512-2dbc8b17e8aa None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:10.589414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9626bf7b-104f-4e2c-9512-2dbc8b17e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:10.602829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf48a4-f153-48fd-8ba6-f43978c9bec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:10.603562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf48a4-f153-48fd-8ba6-f43978c9bec3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.603878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf48a4-f153-48fd-8ba6-f43978c9bec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.604155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf48a4-f153-48fd-8ba6-f43978c9bec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.687817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 62/114] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:10.689293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626bf7b-104f-4e2c-9512-2dbc8b17e8aa None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:10.706546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:10.721391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf48a4-f153-48fd-8ba6-f43978c9bec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:10.722874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf48a4-f153-48fd-8ba6-f43978c9bec3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:10.842052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626bf7b-104f-4e2c-9512-2dbc8b17e8aa None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:10.844387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 53/115] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:10.845105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf48a4-f153-48fd-8ba6-f43978c9bec3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:10.858815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:10.886642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1a18f-7513-464b-ae37-b808df21119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:10.887437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1a18f-7513-464b-ae37-b808df21119f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:10.887724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1a18f-7513-464b-ae37-b808df21119f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:10.888000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1a18f-7513-464b-ae37-b808df21119f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:10.899865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1a18f-7513-464b-ae37-b808df21119f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7eb1a18f-7513-464b-ae37-b808df21119f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:10.904828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:10.905697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:10.906447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 63/116] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:10.907070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1a18f-7513-464b-ae37-b808df21119f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:10.982195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:10.983470 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf48a4-f153-48fd-8ba6-f43978c9bec3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.018810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1a18f-7513-464b-ae37-b808df21119f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.020038 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657ad5f-102c-4a16-b10a-1b44e5b1fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.021318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657ad5f-102c-4a16-b10a-1b44e5b1fb5c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.021848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657ad5f-102c-4a16-b10a-1b44e5b1fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.022313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657ad5f-102c-4a16-b10a-1b44e5b1fb5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.032907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657ad5f-102c-4a16-b10a-1b44e5b1fb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-0657ad5f-102c-4a16-b10a-1b44e5b1fb5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:11.038037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:11.038880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:11.039613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 54/117] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:11.040221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657ad5f-102c-4a16-b10a-1b44e5b1fb5c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.057149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baea3ac-c39b-417d-ab86-51b2ce1a05d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.058030 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baea3ac-c39b-417d-ab86-51b2ce1a05d8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.058327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baea3ac-c39b-417d-ab86-51b2ce1a05d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.058581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baea3ac-c39b-417d-ab86-51b2ce1a05d8 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.059719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baea3ac-c39b-417d-ab86-51b2ce1a05d8 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:11.061274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baea3ac-c39b-417d-ab86-51b2ce1a05d8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:11.067764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 64/118] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:10 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:11.067764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baea3ac-c39b-417d-ab86-51b2ce1a05d8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.117882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:11.164159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657ad5f-102c-4a16-b10a-1b44e5b1fb5c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.177433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baea3ac-c39b-417d-ab86-51b2ce1a05d8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.199673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a09dad-72dc-4fca-8fee-17724f5e9a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.200313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a09dad-72dc-4fca-8fee-17724f5e9a2a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.200595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a09dad-72dc-4fca-8fee-17724f5e9a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.200866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a09dad-72dc-4fca-8fee-17724f5e9a2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.211151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a09dad-72dc-4fca-8fee-17724f5e9a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:11.211652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fe2d2-7fae-4e2f-ad8f-7cb31a92edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.212269 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fe2d2-7fae-4e2f-ad8f-7cb31a92edee None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.212552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fe2d2-7fae-4e2f-ad8f-7cb31a92edee None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.212827 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fe2d2-7fae-4e2f-ad8f-7cb31a92edee None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.213541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fe2d2-7fae-4e2f-ad8f-7cb31a92edee None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:11.213852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fe2d2-7fae-4e2f-ad8f-7cb31a92edee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:11.215232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fe2d2-7fae-4e2f-ad8f-7cb31a92edee None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a0a09dad-72dc-4fca-8fee-17724f5e9a2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:11.216191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:11.216995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:11.217809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 55/119] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:11.218452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a09dad-72dc-4fca-8fee-17724f5e9a2a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.219461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:11.234486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 65/120] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:11.234486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fe2d2-7fae-4e2f-ad8f-7cb31a92edee None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.328937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a09dad-72dc-4fca-8fee-17724f5e9a2a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.333026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fe2d2-7fae-4e2f-ad8f-7cb31a92edee None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.354031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:11.367414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ebbc-2082-4600-9a3a-781a05911556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.368116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ebbc-2082-4600-9a3a-781a05911556 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.368341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ebbc-2082-4600-9a3a-781a05911556 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.368614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ebbc-2082-4600-9a3a-781a05911556 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.368936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050d730-96aa-425d-92a7-1edc4dd1cb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.369587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050d730-96aa-425d-92a7-1edc4dd1cb5f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.369873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050d730-96aa-425d-92a7-1edc4dd1cb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.370152 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050d730-96aa-425d-92a7-1edc4dd1cb5f None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.370830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050d730-96aa-425d-92a7-1edc4dd1cb5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:11.371140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050d730-96aa-425d-92a7-1edc4dd1cb5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:11.372551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050d730-96aa-425d-92a7-1edc4dd1cb5f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:11.381568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 66/121] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:11.385249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050d730-96aa-425d-92a7-1edc4dd1cb5f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.386901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621ebbc-2082-4600-9a3a-781a05911556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f621ebbc-2082-4600-9a3a-781a05911556 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:11.391780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:11.392597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 56/122] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:11.394040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ebbc-2082-4600-9a3a-781a05911556 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.444916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:11.490362 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050d730-96aa-425d-92a7-1edc4dd1cb5f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.502814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ebbc-2082-4600-9a3a-781a05911556 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.525117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840de3ad-a1d5-45a9-b025-448ebfef87a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.525737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840de3ad-a1d5-45a9-b025-448ebfef87a4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.526019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840de3ad-a1d5-45a9-b025-448ebfef87a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.526293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840de3ad-a1d5-45a9-b025-448ebfef87a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.527034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840de3ad-a1d5-45a9-b025-448ebfef87a4 None admin] RBAC: Adding query filter params (role.id=971973e4c615467dbf11c183a74f5d3a, scope.project.id=cd13a123c9a040d092492aaa25e0225e, user.id=dbc5534d5cbe43a889cef7d5614775a9) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:11.527334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840de3ad-a1d5-45a9-b025-448ebfef87a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:11.528826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840de3ad-a1d5-45a9-b025-448ebfef87a4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:11.534437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 67/123] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/role_assignments?user.id=dbc5534d5cbe43a889cef7d5614775a9&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=971973e4c615467dbf11c183a74f5d3a => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:11.539273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3bf5b-6f01-4398-8d67-0eb9967107e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.539905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3bf5b-6f01-4398-8d67-0eb9967107e3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.540190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3bf5b-6f01-4398-8d67-0eb9967107e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.540465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3bf5b-6f01-4398-8d67-0eb9967107e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.541188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3bf5b-6f01-4398-8d67-0eb9967107e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:11.541499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3bf5b-6f01-4398-8d67-0eb9967107e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:11.542495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840de3ad-a1d5-45a9-b025-448ebfef87a4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.542945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3bf5b-6f01-4398-8d67-0eb9967107e3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:11.553220 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 57/124] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:11.559020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3bf5b-6f01-4398-8d67-0eb9967107e3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.613681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:11.677733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840de3ad-a1d5-45a9-b025-448ebfef87a4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.686538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3bf5b-6f01-4398-8d67-0eb9967107e3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.702505 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:11.716908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d85f06-6cc2-496f-8381-17f59cce3cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.716908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d85f06-6cc2-496f-8381-17f59cce3cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.716908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d85f06-6cc2-496f-8381-17f59cce3cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.717239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d85f06-6cc2-496f-8381-17f59cce3cd4 None admin] PATH_INFO: `/v3/users/43415b08461749e6b1c27fcc1a6883b6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.718441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d85f06-6cc2-496f-8381-17f59cce3cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=43415b08461749e6b1c27fcc1a6883b6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:11.720028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d85f06-6cc2-496f-8381-17f59cce3cd4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:11.722630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 68/125] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/users/43415b08461749e6b1c27fcc1a6883b6 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:11.723452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d85f06-6cc2-496f-8381-17f59cce3cd4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.739575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd1cdf-6d50-4519-970f-166c467edb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.740262 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd1cdf-6d50-4519-970f-166c467edb65 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.740584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd1cdf-6d50-4519-970f-166c467edb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.740890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd1cdf-6d50-4519-970f-166c467edb65 None admin] PATH_INFO: `/v3/users/a0f31da57ad743c8a3b7c701031f1af9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.742069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd1cdf-6d50-4519-970f-166c467edb65 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f31da57ad743c8a3b7c701031f1af9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:11.743672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd1cdf-6d50-4519-970f-166c467edb65 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:11.749162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 58/126] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/users/a0f31da57ad743c8a3b7c701031f1af9 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:11.749162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd1cdf-6d50-4519-970f-166c467edb65 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.837965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d85f06-6cc2-496f-8381-17f59cce3cd4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.867215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd1cdf-6d50-4519-970f-166c467edb65 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:11.874873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a2c20-7002-4264-916a-355c88a7a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.875654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a2c20-7002-4264-916a-355c88a7a791 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.876236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a2c20-7002-4264-916a-355c88a7a791 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.876575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a2c20-7002-4264-916a-355c88a7a791 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.877437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a2c20-7002-4264-916a-355c88a7a791 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:11.877803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a2c20-7002-4264-916a-355c88a7a791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:11.879362 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a2c20-7002-4264-916a-355c88a7a791 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:11.882782 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:11.889857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 69/127] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:11.891605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a2c20-7002-4264-916a-355c88a7a791 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.915266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fd3cb-4e87-4631-a450-a2142959cc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:11.915942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fd3cb-4e87-4631-a450-a2142959cc1a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:11.916234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fd3cb-4e87-4631-a450-a2142959cc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:11.917241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fd3cb-4e87-4631-a450-a2142959cc1a None admin] PATH_INFO: `/v3/users/43415b08461749e6b1c27fcc1a6883b6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:11.918713 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fd3cb-4e87-4631-a450-a2142959cc1a None admin] RBAC: Authorizing `identity:get_user(user_id=43415b08461749e6b1c27fcc1a6883b6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:11.920449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fd3cb-4e87-4631-a450-a2142959cc1a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:11.922298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 59/128] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/users/43415b08461749e6b1c27fcc1a6883b6 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:11.923831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fd3cb-4e87-4631-a450-a2142959cc1a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:11.957248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:12.024667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a2c20-7002-4264-916a-355c88a7a791 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:12.046408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fd3cb-4e87-4631-a450-a2142959cc1a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:12.071921 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48488ad5-67eb-4647-bc40-385bd1c30054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:12.073120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488ad5-67eb-4647-bc40-385bd1c30054 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.073959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488ad5-67eb-4647-bc40-385bd1c30054 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.074405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48488ad5-67eb-4647-bc40-385bd1c30054 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:12.076314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48488ad5-67eb-4647-bc40-385bd1c30054 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:12.078645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48488ad5-67eb-4647-bc40-385bd1c30054 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:12.080522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 70/129] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:12.081640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48488ad5-67eb-4647-bc40-385bd1c30054 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:12.081742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab263b0e-19a6-4f68-b9d3-50b89cb31360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:12.082454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab263b0e-19a6-4f68-b9d3-50b89cb31360 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.082837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab263b0e-19a6-4f68-b9d3-50b89cb31360 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.083144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab263b0e-19a6-4f68-b9d3-50b89cb31360 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:12.084491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab263b0e-19a6-4f68-b9d3-50b89cb31360 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:12.086134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab263b0e-19a6-4f68-b9d3-50b89cb31360 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:12.087899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 60/130] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:11 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:12.088788 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab263b0e-19a6-4f68-b9d3-50b89cb31360 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:12.143399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:12.208698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab263b0e-19a6-4f68-b9d3-50b89cb31360 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:12.209657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48488ad5-67eb-4647-bc40-385bd1c30054 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:12.237426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:12.250660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823e772-a9d2-402c-961d-739a64cabfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:12.251951 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823e772-a9d2-402c-961d-739a64cabfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.252690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823e772-a9d2-402c-961d-739a64cabfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.253529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823e772-a9d2-402c-961d-739a64cabfb8 None admin] PATH_INFO: `/v3/projects/234140f91d7a41688962319cf3103ed5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:12.254132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05cd53-6c24-4382-a62d-0fc8de9fa2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:12.254894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823e772-a9d2-402c-961d-739a64cabfb8 None admin] RBAC: Authorizing `identity:get_project(project_id=234140f91d7a41688962319cf3103ed5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:12.255076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05cd53-6c24-4382-a62d-0fc8de9fa2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.255480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05cd53-6c24-4382-a62d-0fc8de9fa2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.255880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05cd53-6c24-4382-a62d-0fc8de9fa2c9 None admin] PATH_INFO: `/v3/users/43415b08461749e6b1c27fcc1a6883b6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:12.256962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823e772-a9d2-402c-961d-739a64cabfb8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:12.257397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05cd53-6c24-4382-a62d-0fc8de9fa2c9 None admin] RBAC: Authorizing `identity:get_user(user_id=43415b08461749e6b1c27fcc1a6883b6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:12.259149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 61/131] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:12 2022] GET /identity/v3/projects/234140f91d7a41688962319cf3103ed5 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:12.259382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05cd53-6c24-4382-a62d-0fc8de9fa2c9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:12.260203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823e772-a9d2-402c-961d-739a64cabfb8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:12.261283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 71/132] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:12 2022] GET /identity/v3/users/43415b08461749e6b1c27fcc1a6883b6 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:12.262175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05cd53-6c24-4382-a62d-0fc8de9fa2c9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:12.369362 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823e772-a9d2-402c-961d-739a64cabfb8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:12.386529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05cd53-6c24-4382-a62d-0fc8de9fa2c9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:12.387851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:12.407831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ec7a9-84a3-4d91-8e7e-f7a7faee5208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:12.408692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec7a9-84a3-4d91-8e7e-f7a7faee5208 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.409094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec7a9-84a3-4d91-8e7e-f7a7faee5208 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.409476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ec7a9-84a3-4d91-8e7e-f7a7faee5208 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e/users/43415b08461749e6b1c27fcc1a6883b6/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:12.411588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ec7a9-84a3-4d91-8e7e-f7a7faee5208 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd13a123c9a040d092492aaa25e0225e, user_id=43415b08461749e6b1c27fcc1a6883b6, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:12.413445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ec7a9-84a3-4d91-8e7e-f7a7faee5208 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:12.426919 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbeb02-b55e-4a1d-8f7b-31d0c2445000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:12.428083 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbeb02-b55e-4a1d-8f7b-31d0c2445000 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.428508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbeb02-b55e-4a1d-8f7b-31d0c2445000 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.428960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbeb02-b55e-4a1d-8f7b-31d0c2445000 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e/users/a0f31da57ad743c8a3b7c701031f1af9/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:12.429970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 62/133] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:56:12 2022] PUT /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e/users/43415b08461749e6b1c27fcc1a6883b6/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:12.431109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ec7a9-84a3-4d91-8e7e-f7a7faee5208 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:12.432444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbeb02-b55e-4a1d-8f7b-31d0c2445000 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd13a123c9a040d092492aaa25e0225e, user_id=a0f31da57ad743c8a3b7c701031f1af9, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:12.434365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbeb02-b55e-4a1d-8f7b-31d0c2445000 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:12.462748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 72/134] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:56:12 2022] PUT /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e/users/a0f31da57ad743c8a3b7c701031f1af9/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:12.464178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbeb02-b55e-4a1d-8f7b-31d0c2445000 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:12.527836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:12.595687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbeb02-b55e-4a1d-8f7b-31d0c2445000 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:12.631973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ec7a9-84a3-4d91-8e7e-f7a7faee5208 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:12.640987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525becea-60c0-4c50-bf07-04d7afd27b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:12.641695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525becea-60c0-4c50-bf07-04d7afd27b03 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.641979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525becea-60c0-4c50-bf07-04d7afd27b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.642257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525becea-60c0-4c50-bf07-04d7afd27b03 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:12.647332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525becea-60c0-4c50-bf07-04d7afd27b03 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:12.648301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525becea-60c0-4c50-bf07-04d7afd27b03 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:12.651248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 73/135] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:12 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:12.657421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525becea-60c0-4c50-bf07-04d7afd27b03 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:12.677178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9293a86-0165-4e9b-b490-37ea175e6799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:12.678357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9293a86-0165-4e9b-b490-37ea175e6799 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.678834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9293a86-0165-4e9b-b490-37ea175e6799 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.679299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9293a86-0165-4e9b-b490-37ea175e6799 None admin] PATH_INFO: `/v3/projects/234140f91d7a41688962319cf3103ed5/users/43415b08461749e6b1c27fcc1a6883b6/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:12.681489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9293a86-0165-4e9b-b490-37ea175e6799 None admin] RBAC: Authorizing `identity:create_grant(project_id=234140f91d7a41688962319cf3103ed5, user_id=43415b08461749e6b1c27fcc1a6883b6, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:12.683288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9293a86-0165-4e9b-b490-37ea175e6799 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:12.704152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 63/136] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:56:12 2022] PUT /identity/v3/projects/234140f91d7a41688962319cf3103ed5/users/43415b08461749e6b1c27fcc1a6883b6/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:12.813024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525becea-60c0-4c50-bf07-04d7afd27b03 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:12.833516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:12.857084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f28dab-fa59-40d7-be72-febd6fe37e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:12.857971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f28dab-fa59-40d7-be72-febd6fe37e1e None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.858261 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f28dab-fa59-40d7-be72-febd6fe37e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.858539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f28dab-fa59-40d7-be72-febd6fe37e1e None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e/users/43415b08461749e6b1c27fcc1a6883b6/roles/ee6045909540420b8b406a308fdad516` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:12.861149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f28dab-fa59-40d7-be72-febd6fe37e1e None admin] RBAC: Authorizing `identity:create_grant(project_id=cd13a123c9a040d092492aaa25e0225e, user_id=43415b08461749e6b1c27fcc1a6883b6, role_id=ee6045909540420b8b406a308fdad516)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:12.862687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f28dab-fa59-40d7-be72-febd6fe37e1e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:12.888990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 74/137] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:56:12 2022] PUT /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e/users/43415b08461749e6b1c27fcc1a6883b6/roles/ee6045909540420b8b406a308fdad516 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:56:12.974201 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50a8c7-5e62-476d-b0b0-ea89d0ceca0c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.975129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50a8c7-5e62-476d-b0b0-ea89d0ceca0c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.975409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50a8c7-5e62-476d-b0b0-ea89d0ceca0c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:12.976993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 64/138] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:12.983238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af2e4-3f24-4d93-80d8-17d51e864d77 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:12.983531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af2e4-3f24-4d93-80d8-17d51e864d77 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:12.983810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347af2e4-3f24-4d93-80d8-17d51e864d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:13.003999 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-347af2e4-3f24-4d93-80d8-17d51e864d77 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:13.005324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-347af2e4-3f24-4d93-80d8-17d51e864d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:13.102823 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 75/139] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:13.512874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50a8c7-5e62-476d-b0b0-ea89d0ceca0c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:13.570071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:13.648523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50a8c7-5e62-476d-b0b0-ea89d0ceca0c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:13.683546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd254825-fe95-4b6e-acd9-3602bb046890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:13.684196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd254825-fe95-4b6e-acd9-3602bb046890 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:13.684479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd254825-fe95-4b6e-acd9-3602bb046890 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:13.684751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd254825-fe95-4b6e-acd9-3602bb046890 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:13.685885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd254825-fe95-4b6e-acd9-3602bb046890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:13.687355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd254825-fe95-4b6e-acd9-3602bb046890 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:13.689267 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 65/140] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:13.695960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af2e4-3f24-4d93-80d8-17d51e864d77 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:13.848817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347af2e4-3f24-4d93-80d8-17d51e864d77 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:13.862925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:13.914551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41587032-531c-4038-8041-5a5556d0ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:13.915555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587032-531c-4038-8041-5a5556d0ec5c None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:13.916028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587032-531c-4038-8041-5a5556d0ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:13.916490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587032-531c-4038-8041-5a5556d0ec5c None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:13.917407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41587032-531c-4038-8041-5a5556d0ec5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:13.919093 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41587032-531c-4038-8041-5a5556d0ec5c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:13.966955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 76/141] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:56:13 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:56:14.319379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94cf33-ce34-45af-aeb7-99b9ce0852e4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:14.319890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94cf33-ce34-45af-aeb7-99b9ce0852e4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:14.319994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94cf33-ce34-45af-aeb7-99b9ce0852e4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:14.321493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 66/142] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:14.329483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d949a0-917e-479c-ab10-dc18f78deb8c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:14.329905 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d949a0-917e-479c-ab10-dc18f78deb8c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:14.330078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d949a0-917e-479c-ab10-dc18f78deb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:14.360194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-31d949a0-917e-479c-ab10-dc18f78deb8c None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:14.361421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-31d949a0-917e-479c-ab10-dc18f78deb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:14.437090 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 77/143] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:14.954390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94cf33-ce34-45af-aeb7-99b9ce0852e4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:15.079575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94cf33-ce34-45af-aeb7-99b9ce0852e4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:15.091340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:15.120800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7a7c-da7a-4759-8a90-3f976adc5daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:15.121481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7a7c-da7a-4759-8a90-3f976adc5daa None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:15.121765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7a7c-da7a-4759-8a90-3f976adc5daa None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:15.122037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7a7c-da7a-4759-8a90-3f976adc5daa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:15.134501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e7a7c-da7a-4759-8a90-3f976adc5daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ba2e7a7c-da7a-4759-8a90-3f976adc5daa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:15.139123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:15.139947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:15.140694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 67/144] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:15.144870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d949a0-917e-479c-ab10-dc18f78deb8c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:15.264962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:15.276928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d949a0-917e-479c-ab10-dc18f78deb8c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:15.320889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46445-9581-4d2f-8254-07a8b0b2b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:15.321552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46445-9581-4d2f-8254-07a8b0b2b7ed None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:15.321831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46445-9581-4d2f-8254-07a8b0b2b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:15.322098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46445-9581-4d2f-8254-07a8b0b2b7ed None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:15.322777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa46445-9581-4d2f-8254-07a8b0b2b7ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:15.323079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa46445-9581-4d2f-8254-07a8b0b2b7ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:15.324474 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa46445-9581-4d2f-8254-07a8b0b2b7ed None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:15.337079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 78/145] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:15.342260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7a7c-da7a-4759-8a90-3f976adc5daa None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:15.462938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7a7c-da7a-4759-8a90-3f976adc5daa None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:15.511099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33da3b-d2dc-4bc2-ae46-423e95d12be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:15.511805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33da3b-d2dc-4bc2-ae46-423e95d12be4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:15.512096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33da3b-d2dc-4bc2-ae46-423e95d12be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:15.512424 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33da3b-d2dc-4bc2-ae46-423e95d12be4 None admin] PATH_INFO: `/v3/users/dbc5534d5cbe43a889cef7d5614775a9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:15.518151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33da3b-d2dc-4bc2-ae46-423e95d12be4 None admin] RBAC: Authorizing `identity:get_user(user_id=dbc5534d5cbe43a889cef7d5614775a9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:15.519600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33da3b-d2dc-4bc2-ae46-423e95d12be4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:15.522132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 68/146] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:15 2022] GET /identity/v3/users/dbc5534d5cbe43a889cef7d5614775a9 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:15.527648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46445-9581-4d2f-8254-07a8b0b2b7ed None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:15.591045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f3c61-08a8-42ef-ba15-2e06c636f244 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:15.591360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f3c61-08a8-42ef-ba15-2e06c636f244 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:15.591607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f3c61-08a8-42ef-ba15-2e06c636f244 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:15.593287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 69/147] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:15.612978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51a2a8-37b5-4e4e-91ab-fa144f3af3a3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:15.613324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51a2a8-37b5-4e4e-91ab-fa144f3af3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:15.613576 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51a2a8-37b5-4e4e-91ab-fa144f3af3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:15.654754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ad51a2a8-37b5-4e4e-91ab-fa144f3af3a3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:15.655998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ad51a2a8-37b5-4e4e-91ab-fa144f3af3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:15.666059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46445-9581-4d2f-8254-07a8b0b2b7ed None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:15.703812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:15.721159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e068a-4675-4471-bf1c-62a58ad6a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:15.722150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e068a-4675-4471-bf1c-62a58ad6a6aa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:15.722811 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e068a-4675-4471-bf1c-62a58ad6a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:15.723951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e068a-4675-4471-bf1c-62a58ad6a6aa None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:15.725525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e068a-4675-4471-bf1c-62a58ad6a6aa None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:15.727209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e068a-4675-4471-bf1c-62a58ad6a6aa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:15.729186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 79/148] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:15 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:15.730631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6b11-53c6-4861-8411-a2ed1e246595 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:15.731118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6b11-53c6-4861-8411-a2ed1e246595 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:15.731603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6b11-53c6-4861-8411-a2ed1e246595 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:15.734833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 80/149] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:15.736829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c6b11-53c6-4861-8411-a2ed1e246595 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:15.773612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:15.777061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 70/150] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:15.777061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c13c2-0271-49da-9aa9-1bf2bca75e88 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:15.777061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c13c2-0271-49da-9aa9-1bf2bca75e88 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:15.777365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c13c2-0271-49da-9aa9-1bf2bca75e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:15.806440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-576c13c2-0271-49da-9aa9-1bf2bca75e88 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:15.809123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-576c13c2-0271-49da-9aa9-1bf2bca75e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:15.904694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 71/151] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:15.921740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c6b11-53c6-4861-8411-a2ed1e246595 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:15.957345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0503e-0db5-4412-932f-745969f849a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:15.958013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0503e-0db5-4412-932f-745969f849a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:15.958288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0503e-0db5-4412-932f-745969f849a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:15.958557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0503e-0db5-4412-932f-745969f849a1 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e/users/dbc5534d5cbe43a889cef7d5614775a9/roles/971973e4c615467dbf11c183a74f5d3a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:15.966293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0503e-0db5-4412-932f-745969f849a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd13a123c9a040d092492aaa25e0225e, user_id=dbc5534d5cbe43a889cef7d5614775a9, role_id=971973e4c615467dbf11c183a74f5d3a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:15.967770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0503e-0db5-4412-932f-745969f849a1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:15.990017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 81/152] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:56:15 2022] PUT /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e/users/dbc5534d5cbe43a889cef7d5614775a9/roles/971973e4c615467dbf11c183a74f5d3a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:56:15.999384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac263390-5728-4225-807b-04744baf587d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:15.999686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac263390-5728-4225-807b-04744baf587d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:15.999977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac263390-5728-4225-807b-04744baf587d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:16.001355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 72/153] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:16.007439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a941934-49bc-4720-9a37-58655b52d430 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:16.007723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a941934-49bc-4720-9a37-58655b52d430 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:16.007984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a941934-49bc-4720-9a37-58655b52d430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:16.034182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3a941934-49bc-4720-9a37-58655b52d430 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:16.035296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3a941934-49bc-4720-9a37-58655b52d430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:16.109792 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 82/154] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:16.337306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac263390-5728-4225-807b-04744baf587d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:16.360259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a941934-49bc-4720-9a37-58655b52d430 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:16.377092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:16.463004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:16.482529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac263390-5728-4225-807b-04744baf587d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:16.490216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a941934-49bc-4720-9a37-58655b52d430 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:16.532553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d610f-67ca-4d97-ab45-b5888391f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:16.532794 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77545d-e066-4e96-965b-d3a28ae05b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:16.533235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77545d-e066-4e96-965b-d3a28ae05b6f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:16.533685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77545d-e066-4e96-965b-d3a28ae05b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:16.533955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d610f-67ca-4d97-ab45-b5888391f173 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:16.534265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77545d-e066-4e96-965b-d3a28ae05b6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:16.534375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d610f-67ca-4d97-ab45-b5888391f173 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:16.534758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d610f-67ca-4d97-ab45-b5888391f173 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:16.548993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d610f-67ca-4d97-ab45-b5888391f173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:16.550128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77545d-e066-4e96-965b-d3a28ae05b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8e2d610f-67ca-4d97-ab45-b5888391f173 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:16.552078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:16.553080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:16.553881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 83/155] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:56:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ca77545d-e066-4e96-965b-d3a28ae05b6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:16.558083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:16.558907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:16.559864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:16.561914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d610f-67ca-4d97-ab45-b5888391f173 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:16.562440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 73/156] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:16.569198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77545d-e066-4e96-965b-d3a28ae05b6f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:16.649564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:16.682107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77545d-e066-4e96-965b-d3a28ae05b6f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:16.685334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d610f-67ca-4d97-ab45-b5888391f173 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:16.716886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1550-176a-493b-a30f-cc48219d06ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:16.717897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1550-176a-493b-a30f-cc48219d06ee None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:16.718365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1550-176a-493b-a30f-cc48219d06ee None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:16.718850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1550-176a-493b-a30f-cc48219d06ee None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:16.719721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d1550-176a-493b-a30f-cc48219d06ee None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:16.720224 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d1550-176a-493b-a30f-cc48219d06ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:16.721923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d1550-176a-493b-a30f-cc48219d06ee None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:16.724531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22dfee-a529-4b68-ace6-13cde0e120b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:16.725344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22dfee-a529-4b68-ace6-13cde0e120b9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:16.725626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22dfee-a529-4b68-ace6-13cde0e120b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:16.725899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22dfee-a529-4b68-ace6-13cde0e120b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:16.726586 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22dfee-a529-4b68-ace6-13cde0e120b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:16.726890 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22dfee-a529-4b68-ace6-13cde0e120b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:16.728485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22dfee-a529-4b68-ace6-13cde0e120b9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:16.732876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 74/157] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:16.742836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 84/158] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:16.748777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1550-176a-493b-a30f-cc48219d06ee None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:16.748926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22dfee-a529-4b68-ace6-13cde0e120b9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:16.781060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:16.863225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22dfee-a529-4b68-ace6-13cde0e120b9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:16.894455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1550-176a-493b-a30f-cc48219d06ee None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:16.901792 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04995fb1-3f4e-4943-a829-de7ac02f5906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:16.902370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04995fb1-3f4e-4943-a829-de7ac02f5906 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:16.902656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04995fb1-3f4e-4943-a829-de7ac02f5906 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:16.902931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04995fb1-3f4e-4943-a829-de7ac02f5906 None admin] PATH_INFO: `/v3/users/43415b08461749e6b1c27fcc1a6883b6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:16.904215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04995fb1-3f4e-4943-a829-de7ac02f5906 None admin] RBAC: Authorizing `identity:get_user(user_id=43415b08461749e6b1c27fcc1a6883b6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:16.905711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04995fb1-3f4e-4943-a829-de7ac02f5906 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:16.907797 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 85/159] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:16 2022] GET /identity/v3/users/43415b08461749e6b1c27fcc1a6883b6 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:16.908488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04995fb1-3f4e-4943-a829-de7ac02f5906 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:16.915868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:16.948549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fad093-6cb5-410f-8081-db7135c7fa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:16.949616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fad093-6cb5-410f-8081-db7135c7fa84 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:16.950085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fad093-6cb5-410f-8081-db7135c7fa84 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:16.950539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fad093-6cb5-410f-8081-db7135c7fa84 None admin] PATH_INFO: `/v3/users/a0f31da57ad743c8a3b7c701031f1af9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:16.951870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fad093-6cb5-410f-8081-db7135c7fa84 None admin] RBAC: Authorizing `identity:get_user(user_id=a0f31da57ad743c8a3b7c701031f1af9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:16.953574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fad093-6cb5-410f-8081-db7135c7fa84 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:16.955686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 75/160] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:16 2022] GET /identity/v3/users/a0f31da57ad743c8a3b7c701031f1af9 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:16.956650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fad093-6cb5-410f-8081-db7135c7fa84 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:17.030193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04995fb1-3f4e-4943-a829-de7ac02f5906 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:17.066546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ce14c-016f-472d-8677-cb48846cb391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:17.067583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ce14c-016f-472d-8677-cb48846cb391 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:17.068055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ce14c-016f-472d-8677-cb48846cb391 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:17.068542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ce14c-016f-472d-8677-cb48846cb391 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:17.079600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:17.082171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ce14c-016f-472d-8677-cb48846cb391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-936ce14c-016f-472d-8677-cb48846cb391 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:17.088483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:17.089926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:17.090902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:17.093691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 86/161] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:17.094629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ce14c-016f-472d-8677-cb48846cb391 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:17.101792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fad093-6cb5-410f-8081-db7135c7fa84 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:17.156725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859ae40-f065-4c64-a37b-3de9db987d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:17.157323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859ae40-f065-4c64-a37b-3de9db987d98 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:17.157604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859ae40-f065-4c64-a37b-3de9db987d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:17.157873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859ae40-f065-4c64-a37b-3de9db987d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:17.184158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:17.243121 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859ae40-f065-4c64-a37b-3de9db987d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:17.244637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859ae40-f065-4c64-a37b-3de9db987d98 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:17.279311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ce14c-016f-472d-8677-cb48846cb391 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:17.358177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:17.374314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101d71-ac3a-4d3a-8bee-40cd38ac45db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:17.374962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101d71-ac3a-4d3a-8bee-40cd38ac45db None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:17.375231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101d71-ac3a-4d3a-8bee-40cd38ac45db None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:17.375509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101d71-ac3a-4d3a-8bee-40cd38ac45db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:17.377796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 76/162] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:17.378690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859ae40-f065-4c64-a37b-3de9db987d98 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:17.497205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859ae40-f065-4c64-a37b-3de9db987d98 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:17.530993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101d71-ac3a-4d3a-8bee-40cd38ac45db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:17.532488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101d71-ac3a-4d3a-8bee-40cd38ac45db None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:17.545130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f77a7-6f9a-428f-a37a-03950fa3d6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:17.545755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f77a7-6f9a-428f-a37a-03950fa3d6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:17.546035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f77a7-6f9a-428f-a37a-03950fa3d6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:17.546306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f77a7-6f9a-428f-a37a-03950fa3d6e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:17.546985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f77a7-6f9a-428f-a37a-03950fa3d6e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:17.547285 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f77a7-6f9a-428f-a37a-03950fa3d6e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:17.548661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f77a7-6f9a-428f-a37a-03950fa3d6e0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:17.564581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 77/163] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:17.565762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f77a7-6f9a-428f-a37a-03950fa3d6e0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:17.652736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:17.662711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:17.724002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 87/164] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:17.725414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc458f1d-7fde-472b-998a-42538b00d88f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:17.725695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc458f1d-7fde-472b-998a-42538b00d88f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:17.725965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc458f1d-7fde-472b-998a-42538b00d88f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:17.727598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 88/165] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:17.728338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc458f1d-7fde-472b-998a-42538b00d88f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:17.767050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f77a7-6f9a-428f-a37a-03950fa3d6e0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:17.806763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f0df-fa5f-48c9-b5ac-33d043e00c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:17.807800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f0df-fa5f-48c9-b5ac-33d043e00c83 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:17.808301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f0df-fa5f-48c9-b5ac-33d043e00c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:17.808860 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f0df-fa5f-48c9-b5ac-33d043e00c83 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:17.811171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f0df-fa5f-48c9-b5ac-33d043e00c83 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:17.813065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f0df-fa5f-48c9-b5ac-33d043e00c83 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:17.820251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 78/166] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:17 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:17.821857 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f93fb-8ab4-499e-8fe6-dd40ec6082f3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:17.822369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f93fb-8ab4-499e-8fe6-dd40ec6082f3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:17.823170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f93fb-8ab4-499e-8fe6-dd40ec6082f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:17.843909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-717f93fb-8ab4-499e-8fe6-dd40ec6082f3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:17.845519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-717f93fb-8ab4-499e-8fe6-dd40ec6082f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:17.922127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 79/167] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:17.923379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f93fb-8ab4-499e-8fe6-dd40ec6082f3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:17.925789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc458f1d-7fde-472b-998a-42538b00d88f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:17.975482 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:18.018879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09501fa-23c2-43da-af13-cc7b8963aaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:18.019453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09501fa-23c2-43da-af13-cc7b8963aaaa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:18.019732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09501fa-23c2-43da-af13-cc7b8963aaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:18.019998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09501fa-23c2-43da-af13-cc7b8963aaaa None admin] PATH_INFO: `/v3/users/43415b08461749e6b1c27fcc1a6883b6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:18.021576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09501fa-23c2-43da-af13-cc7b8963aaaa None admin] RBAC: Authorizing `identity:get_user(user_id=43415b08461749e6b1c27fcc1a6883b6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:18.023095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09501fa-23c2-43da-af13-cc7b8963aaaa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:18.024999 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 89/168] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:17 2022] GET /identity/v3/users/43415b08461749e6b1c27fcc1a6883b6 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:18.025788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09501fa-23c2-43da-af13-cc7b8963aaaa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:18.040335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f93fb-8ab4-499e-8fe6-dd40ec6082f3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:18.079493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff34939-0a11-4f89-948c-6523993a5a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:18.080546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff34939-0a11-4f89-948c-6523993a5a7e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:18.081522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff34939-0a11-4f89-948c-6523993a5a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:18.082016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff34939-0a11-4f89-948c-6523993a5a7e None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:18.083425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff34939-0a11-4f89-948c-6523993a5a7e None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:18.085298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff34939-0a11-4f89-948c-6523993a5a7e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:18.088005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 80/169] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:17 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:18.088988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff34939-0a11-4f89-948c-6523993a5a7e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:18.106616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:18.218459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff34939-0a11-4f89-948c-6523993a5a7e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:18.233383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:18.258431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab378d-d07e-4728-919c-c165c2053ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:18.259575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab378d-d07e-4728-919c-c165c2053ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:18.260120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab378d-d07e-4728-919c-c165c2053ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:18.260593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab378d-d07e-4728-919c-c165c2053ff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:18.294938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09501fa-23c2-43da-af13-cc7b8963aaaa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:18.337454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab378d-d07e-4728-919c-c165c2053ff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:18.340517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab378d-d07e-4728-919c-c165c2053ff1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:18.377785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b4d6-b45f-4bcc-b813-ddd2d3b0b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:18.378571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b4d6-b45f-4bcc-b813-ddd2d3b0b18b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:18.378694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b4d6-b45f-4bcc-b813-ddd2d3b0b18b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:18.379044 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b4d6-b45f-4bcc-b813-ddd2d3b0b18b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:18.379766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220b4d6-b45f-4bcc-b813-ddd2d3b0b18b None admin] RBAC: Adding query filter params (role.id=b86a73fa9cc046eeae600bffd4218e7b, scope.project.id=cd13a123c9a040d092492aaa25e0225e, user.id=43415b08461749e6b1c27fcc1a6883b6) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:18.380006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220b4d6-b45f-4bcc-b813-ddd2d3b0b18b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:18.381560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220b4d6-b45f-4bcc-b813-ddd2d3b0b18b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:18.387727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 90/170] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:18 2022] GET /identity/v3/role_assignments?user.id=43415b08461749e6b1c27fcc1a6883b6&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 608 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:18.388605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b4d6-b45f-4bcc-b813-ddd2d3b0b18b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:18.519930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 81/171] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:18.526421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab378d-d07e-4728-919c-c165c2053ff1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:18.546746 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:18.561191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b4d6-b45f-4bcc-b813-ddd2d3b0b18b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:18.569473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:18.626509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe1c36-3f4b-4e18-891b-43c0ef80d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:18.627148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe1c36-3f4b-4e18-891b-43c0ef80d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:18.627428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe1c36-3f4b-4e18-891b-43c0ef80d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:18.627703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe1c36-3f4b-4e18-891b-43c0ef80d6e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:18.628463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe1c36-3f4b-4e18-891b-43c0ef80d6e3 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=cd13a123c9a040d092492aaa25e0225e, user.id=a0f31da57ad743c8a3b7c701031f1af9) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:18.628849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe1c36-3f4b-4e18-891b-43c0ef80d6e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:18.630510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe1c36-3f4b-4e18-891b-43c0ef80d6e3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:18.649092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 91/172] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:18 2022] GET /identity/v3/role_assignments?user.id=a0f31da57ad743c8a3b7c701031f1af9&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=77285ef607e34662b6234656fe8043d0 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:18.649092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe1c36-3f4b-4e18-891b-43c0ef80d6e3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:18.680904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab378d-d07e-4728-919c-c165c2053ff1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:18.745669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129061f4-361f-455e-82dd-62fed0de221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:18.746723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129061f4-361f-455e-82dd-62fed0de221d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:18.747216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129061f4-361f-455e-82dd-62fed0de221d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:18.747723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129061f4-361f-455e-82dd-62fed0de221d None admin] PATH_INFO: `/v3/projects/234140f91d7a41688962319cf3103ed5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:18.753323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129061f4-361f-455e-82dd-62fed0de221d None admin] RBAC: Authorizing `identity:get_project(project_id=234140f91d7a41688962319cf3103ed5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:18.755292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129061f4-361f-455e-82dd-62fed0de221d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:18.757416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 82/173] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:18 2022] GET /identity/v3/projects/234140f91d7a41688962319cf3103ed5 => generated 312 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:18.762903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1940eb-f93c-41c7-b521-255049986ec5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:18.763526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1940eb-f93c-41c7-b521-255049986ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:18.764089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1940eb-f93c-41c7-b521-255049986ec5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:18.765680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 83/174] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:18.766566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1940eb-f93c-41c7-b521-255049986ec5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:18.809423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe1c36-3f4b-4e18-891b-43c0ef80d6e3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:18.881867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af50845-bbdf-483d-9469-9d81613ab482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:18.882537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af50845-bbdf-483d-9469-9d81613ab482 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:18.882815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af50845-bbdf-483d-9469-9d81613ab482 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:18.883674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af50845-bbdf-483d-9469-9d81613ab482 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:18.894909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:18.902619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af50845-bbdf-483d-9469-9d81613ab482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0af50845-bbdf-483d-9469-9d81613ab482 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:18.908818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:18.909815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:18.910594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 92/175] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:18.911748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fc9c9-e59d-4260-a51a-39fa72f01099 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:18.911748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fc9c9-e59d-4260-a51a-39fa72f01099 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:18.911906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fc9c9-e59d-4260-a51a-39fa72f01099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:18.931503 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1940eb-f93c-41c7-b521-255049986ec5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:18.946251 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-da6fc9c9-e59d-4260-a51a-39fa72f01099 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:18.947477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-da6fc9c9-e59d-4260-a51a-39fa72f01099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:18.969901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:18.972657 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617262ea-e2c1-469f-8705-8c1ece6c3d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:18.973752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617262ea-e2c1-469f-8705-8c1ece6c3d09 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:18.974245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617262ea-e2c1-469f-8705-8c1ece6c3d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:18.975154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617262ea-e2c1-469f-8705-8c1ece6c3d09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:18.976529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617262ea-e2c1-469f-8705-8c1ece6c3d09 None admin] RBAC: Adding query filter params (role.id=b86a73fa9cc046eeae600bffd4218e7b, scope.project.id=234140f91d7a41688962319cf3103ed5, user.id=43415b08461749e6b1c27fcc1a6883b6) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:18.977073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617262ea-e2c1-469f-8705-8c1ece6c3d09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:18.978798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617262ea-e2c1-469f-8705-8c1ece6c3d09 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:18.985920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 84/176] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:18 2022] GET /identity/v3/role_assignments?user.id=43415b08461749e6b1c27fcc1a6883b6&scope.project.id=234140f91d7a41688962319cf3103ed5&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:18.987047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617262ea-e2c1-469f-8705-8c1ece6c3d09 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:19.077240 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 93/177] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:19.109238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617262ea-e2c1-469f-8705-8c1ece6c3d09 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:19.161013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f827f5d-9323-4bf4-80f2-e6736cd2d19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:19.162084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f827f5d-9323-4bf4-80f2-e6736cd2d19b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:19.162642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f827f5d-9323-4bf4-80f2-e6736cd2d19b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:19.163122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f827f5d-9323-4bf4-80f2-e6736cd2d19b None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:19.163989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f827f5d-9323-4bf4-80f2-e6736cd2d19b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:19.164546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f827f5d-9323-4bf4-80f2-e6736cd2d19b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:19.166237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f827f5d-9323-4bf4-80f2-e6736cd2d19b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:19.176518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 85/178] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:19.182426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fc9c9-e59d-4260-a51a-39fa72f01099 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:19.292734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fc9c9-e59d-4260-a51a-39fa72f01099 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:19.336300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ddbc-7cdb-4d40-a21c-2adca5b34cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:19.337357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ddbc-7cdb-4d40-a21c-2adca5b34cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:19.337898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ddbc-7cdb-4d40-a21c-2adca5b34cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:19.338364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ddbc-7cdb-4d40-a21c-2adca5b34cb1 None admin] PATH_INFO: `/v3/users/43415b08461749e6b1c27fcc1a6883b6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:19.339822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5ddbc-7cdb-4d40-a21c-2adca5b34cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=43415b08461749e6b1c27fcc1a6883b6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:19.341541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5ddbc-7cdb-4d40-a21c-2adca5b34cb1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:19.343350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 94/179] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:19 2022] GET /identity/v3/users/43415b08461749e6b1c27fcc1a6883b6 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:19.349081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f827f5d-9323-4bf4-80f2-e6736cd2d19b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:19.359769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:19.463940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f827f5d-9323-4bf4-80f2-e6736cd2d19b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:19.469283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ddbc-7cdb-4d40-a21c-2adca5b34cb1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:19.496301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:19.506226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6350f-7c05-400c-a2b5-898db32db3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:19.506903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6350f-7c05-400c-a2b5-898db32db3fe None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:19.507195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6350f-7c05-400c-a2b5-898db32db3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:19.507471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6350f-7c05-400c-a2b5-898db32db3fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:19.588166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6350f-7c05-400c-a2b5-898db32db3fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:19.590055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6350f-7c05-400c-a2b5-898db32db3fe None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:19.601770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:19.604063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ddbc-7cdb-4d40-a21c-2adca5b34cb1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:19.644386 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb92ad-1cfb-4496-8535-7aaa37a4fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:19.647361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb92ad-1cfb-4496-8535-7aaa37a4fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:19.647693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb92ad-1cfb-4496-8535-7aaa37a4fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:19.648094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb92ad-1cfb-4496-8535-7aaa37a4fbd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:19.659272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb92ad-1cfb-4496-8535-7aaa37a4fbd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-35cb92ad-1cfb-4496-8535-7aaa37a4fbd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:19.665059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:19.665927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:19.666690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:19.669206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 95/180] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:56:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:56:19.673766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb92ad-1cfb-4496-8535-7aaa37a4fbd8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:19.716149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 86/181] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:19.717504 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e23a-9cc2-4ed2-b614-273e2a22a4ce None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:19.717941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e23a-9cc2-4ed2-b614-273e2a22a4ce None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:19.718216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622e23a-9cc2-4ed2-b614-273e2a22a4ce None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:19.720317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 87/182] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:19.725950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622e23a-9cc2-4ed2-b614-273e2a22a4ce None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:19.781433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:19.804351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb92ad-1cfb-4496-8535-7aaa37a4fbd8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:19.851144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395c905-0121-456f-b4d3-9f071a469867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:19.852099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395c905-0121-456f-b4d3-9f071a469867 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:19.852516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395c905-0121-456f-b4d3-9f071a469867 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:19.852910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395c905-0121-456f-b4d3-9f071a469867 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:19.853848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395c905-0121-456f-b4d3-9f071a469867 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:19.854158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395c905-0121-456f-b4d3-9f071a469867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:19.856286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395c905-0121-456f-b4d3-9f071a469867 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:19.861432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622e23a-9cc2-4ed2-b614-273e2a22a4ce None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:19.867541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 96/183] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:19.873012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:19.875531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522a46e-3a27-46bc-bf11-eb3dd3915762 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:19.875974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522a46e-3a27-46bc-bf11-eb3dd3915762 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:19.876706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522a46e-3a27-46bc-bf11-eb3dd3915762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:19.895541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d522a46e-3a27-46bc-bf11-eb3dd3915762 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:19.897368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d522a46e-3a27-46bc-bf11-eb3dd3915762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:19.901621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dae97b-7654-4a01-bbee-df623c03e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:19.902311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae97b-7654-4a01-bbee-df623c03e41a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:19.902587 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae97b-7654-4a01-bbee-df623c03e41a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:19.902852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dae97b-7654-4a01-bbee-df623c03e41a None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:19.903993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dae97b-7654-4a01-bbee-df623c03e41a None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:19.905461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dae97b-7654-4a01-bbee-df623c03e41a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:19.911983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 88/184] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:19 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:19.911983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dae97b-7654-4a01-bbee-df623c03e41a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:19.973061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 97/185] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:19.973061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab192c1-7bdc-4436-8a26-850d3e91bb4a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:19.973061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab192c1-7bdc-4436-8a26-850d3e91bb4a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:19.973061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab192c1-7bdc-4436-8a26-850d3e91bb4a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:19.973061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 98/186] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:19.973061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab192c1-7bdc-4436-8a26-850d3e91bb4a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:20.032787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dae97b-7654-4a01-bbee-df623c03e41a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:20.041874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:20.077571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98a610-58a8-4916-8670-db8c9a6bb60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:20.078389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab192c1-7bdc-4436-8a26-850d3e91bb4a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:20.078719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a610-58a8-4916-8670-db8c9a6bb60c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.079133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a610-58a8-4916-8670-db8c9a6bb60c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.079537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a610-58a8-4916-8670-db8c9a6bb60c None admin] PATH_INFO: `/v3/users/2987c8ad7f004e5599404ce2e6caff95` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.096595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98a610-58a8-4916-8670-db8c9a6bb60c None admin] RBAC: Authorizing `identity:get_user(user_id=2987c8ad7f004e5599404ce2e6caff95)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:20.098375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98a610-58a8-4916-8670-db8c9a6bb60c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:20.100686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 89/187] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:19 2022] GET /identity/v3/users/2987c8ad7f004e5599404ce2e6caff95 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:20.102413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56791a1-c876-4cb3-8911-8d591417bf2e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.102853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56791a1-c876-4cb3-8911-8d591417bf2e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.103264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56791a1-c876-4cb3-8911-8d591417bf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.118899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4ccc-e694-4dfd-bf43-70b10ce3541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:20.119547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4ccc-e694-4dfd-bf43-70b10ce3541c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.119885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4ccc-e694-4dfd-bf43-70b10ce3541c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.120160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b4ccc-e694-4dfd-bf43-70b10ce3541c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.120898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b4ccc-e694-4dfd-bf43-70b10ce3541c None admin] RBAC: Adding query filter params (role.id=ee6045909540420b8b406a308fdad516, scope.project.id=cd13a123c9a040d092492aaa25e0225e, user.id=43415b08461749e6b1c27fcc1a6883b6) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:20.121249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b4ccc-e694-4dfd-bf43-70b10ce3541c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:20.122725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b4ccc-e694-4dfd-bf43-70b10ce3541c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:20.125027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f56791a1-c876-4cb3-8911-8d591417bf2e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:20.126837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f56791a1-c876-4cb3-8911-8d591417bf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:20.129193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 99/188] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:19 2022] GET /identity/v3/role_assignments?user.id=43415b08461749e6b1c27fcc1a6883b6&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=ee6045909540420b8b406a308fdad516 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:20.130267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4ccc-e694-4dfd-bf43-70b10ce3541c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:20.169448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:20.210912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 90/189] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:20.255160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b4ccc-e694-4dfd-bf43-70b10ce3541c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:20.288160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:20.298475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56791a1-c876-4cb3-8911-8d591417bf2e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:20.313361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f83b2-d92a-4493-85ea-652754e624e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:20.313993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f83b2-d92a-4493-85ea-652754e624e3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.314266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f83b2-d92a-4493-85ea-652754e624e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.314532 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f83b2-d92a-4493-85ea-652754e624e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.465543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f83b2-d92a-4493-85ea-652754e624e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:20.466604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56791a1-c876-4cb3-8911-8d591417bf2e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:20.466923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f83b2-d92a-4493-85ea-652754e624e3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:20.511467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91b13f-8fed-4df8-b019-4871d45a7dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:20.511676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91b13f-8fed-4df8-b019-4871d45a7dea None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.511915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91b13f-8fed-4df8-b019-4871d45a7dea None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.512194 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91b13f-8fed-4df8-b019-4871d45a7dea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.526544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91b13f-8fed-4df8-b019-4871d45a7dea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6c91b13f-8fed-4df8-b019-4871d45a7dea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:20.531400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:20.532272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:20.533227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 91/190] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:56:20.534111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd6fc7-a072-47db-8311-f15bcc4d1e35 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.534370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd6fc7-a072-47db-8311-f15bcc4d1e35 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.535157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd6fc7-a072-47db-8311-f15bcc4d1e35 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.536453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 92/191] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:20.537264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd6fc7-a072-47db-8311-f15bcc4d1e35 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:20.563447 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:20.588940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 100/192] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:20.588940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f83b2-d92a-4493-85ea-652754e624e3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:20.617005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:20.641613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd6fc7-a072-47db-8311-f15bcc4d1e35 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:20.674680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cc1ea-bc9e-4b8b-908d-ea8c057566a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:20.675295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cc1ea-bc9e-4b8b-908d-ea8c057566a4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.675634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cc1ea-bc9e-4b8b-908d-ea8c057566a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.675903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cc1ea-bc9e-4b8b-908d-ea8c057566a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.676990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cc1ea-bc9e-4b8b-908d-ea8c057566a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:20.678494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cc1ea-bc9e-4b8b-908d-ea8c057566a4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:20.680052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 93/193] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:20.681155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc8fe2-ec76-4a2f-be3a-13d608442f2b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.681429 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc8fe2-ec76-4a2f-be3a-13d608442f2b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.681695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc8fe2-ec76-4a2f-be3a-13d608442f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.683693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f83b2-d92a-4493-85ea-652754e624e3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:20.698763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a0dc8fe2-ec76-4a2f-be3a-13d608442f2b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:20.699941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a0dc8fe2-ec76-4a2f-be3a-13d608442f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:20.717292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7816-2de0-4701-982c-5e3b164ebc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:20.717838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7816-2de0-4701-982c-5e3b164ebc6c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.718115 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7816-2de0-4701-982c-5e3b164ebc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.718386 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7816-2de0-4701-982c-5e3b164ebc6c None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.719052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7816-2de0-4701-982c-5e3b164ebc6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:20.719351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7816-2de0-4701-982c-5e3b164ebc6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:20.720733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7816-2de0-4701-982c-5e3b164ebc6c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:20.728560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 101/194] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:20.729353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7816-2de0-4701-982c-5e3b164ebc6c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:20.766176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 94/195] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:20.766835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc8fe2-ec76-4a2f-be3a-13d608442f2b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:20.787536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:20.837960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:20.846254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7816-2de0-4701-982c-5e3b164ebc6c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:20.873171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc8fe2-ec76-4a2f-be3a-13d608442f2b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:20.881711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af002578-abfe-412c-9d62-12a259a0157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:20.882963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af002578-abfe-412c-9d62-12a259a0157a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.883462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af002578-abfe-412c-9d62-12a259a0157a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.884207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af002578-abfe-412c-9d62-12a259a0157a None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.885841 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af002578-abfe-412c-9d62-12a259a0157a None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:20.888262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af002578-abfe-412c-9d62-12a259a0157a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:20.890585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 102/196] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:20 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:20.891539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af002578-abfe-412c-9d62-12a259a0157a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:20.907373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2bd92-1c7f-43bc-aed3-1a59ca1a3d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:20.907990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2bd92-1c7f-43bc-aed3-1a59ca1a3d81 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:20.908270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2bd92-1c7f-43bc-aed3-1a59ca1a3d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:20.908556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2bd92-1c7f-43bc-aed3-1a59ca1a3d81 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:20.909222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2bd92-1c7f-43bc-aed3-1a59ca1a3d81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:20.910672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2bd92-1c7f-43bc-aed3-1a59ca1a3d81 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:20.937063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 95/197] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:56:20 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:56:20.937906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2bd92-1c7f-43bc-aed3-1a59ca1a3d81 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:21.014283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af002578-abfe-412c-9d62-12a259a0157a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:21.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:21.056822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b8e86-a730-467f-b71f-aba48276e1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:21.057520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8e86-a730-467f-b71f-aba48276e1de None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:21.057795 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8e86-a730-467f-b71f-aba48276e1de None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:21.058066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8e86-a730-467f-b71f-aba48276e1de None admin] PATH_INFO: `/v3/users/2987c8ad7f004e5599404ce2e6caff95` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:21.059335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b8e86-a730-467f-b71f-aba48276e1de None admin] RBAC: Authorizing `identity:get_user(user_id=2987c8ad7f004e5599404ce2e6caff95)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:21.061153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b8e86-a730-467f-b71f-aba48276e1de None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:21.062948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 103/198] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:20 2022] GET /identity/v3/users/2987c8ad7f004e5599404ce2e6caff95 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:21.063556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b8e86-a730-467f-b71f-aba48276e1de None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:21.086562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2bd92-1c7f-43bc-aed3-1a59ca1a3d81 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:21.100030 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:21.127806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cdf99-e33e-410c-ac9b-b1de536f20c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:21.128682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cdf99-e33e-410c-ac9b-b1de536f20c0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:21.128967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cdf99-e33e-410c-ac9b-b1de536f20c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:21.129266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cdf99-e33e-410c-ac9b-b1de536f20c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:21.130020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cdf99-e33e-410c-ac9b-b1de536f20c0 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c, user.id=2987c8ad7f004e5599404ce2e6caff95) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:21.130321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cdf99-e33e-410c-ac9b-b1de536f20c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:21.131856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cdf99-e33e-410c-ac9b-b1de536f20c0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:21.140176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 96/199] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:20 2022] GET /identity/v3/role_assignments?user.id=2987c8ad7f004e5599404ce2e6caff95&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=77285ef607e34662b6234656fe8043d0 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:21.141014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cdf99-e33e-410c-ac9b-b1de536f20c0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:21.214654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b8e86-a730-467f-b71f-aba48276e1de None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:21.257527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22ec08-4a3f-46f3-8bfc-9dcafde981a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:21.258550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22ec08-4a3f-46f3-8bfc-9dcafde981a7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:21.259025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22ec08-4a3f-46f3-8bfc-9dcafde981a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:21.260055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22ec08-4a3f-46f3-8bfc-9dcafde981a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:21.273833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cdf99-e33e-410c-ac9b-b1de536f20c0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:21.276014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c22ec08-4a3f-46f3-8bfc-9dcafde981a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6c22ec08-4a3f-46f3-8bfc-9dcafde981a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:21.282831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:21.283753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:21.284518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:21.287768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 104/200] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:21.295200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22ec08-4a3f-46f3-8bfc-9dcafde981a7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:21.330566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069561d-0907-4839-8888-3a7617ed0889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:21.331204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069561d-0907-4839-8888-3a7617ed0889 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:21.331501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069561d-0907-4839-8888-3a7617ed0889 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:21.331763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069561d-0907-4839-8888-3a7617ed0889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:21.344620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:21.409066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:21.413795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069561d-0907-4839-8888-3a7617ed0889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:21.415293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069561d-0907-4839-8888-3a7617ed0889 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:21.427747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22ec08-4a3f-46f3-8bfc-9dcafde981a7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:21.479180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10aba7-15f7-4602-848f-ad291c1d91b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:21.479812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10aba7-15f7-4602-848f-ad291c1d91b8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:21.480086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10aba7-15f7-4602-848f-ad291c1d91b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:21.480343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10aba7-15f7-4602-848f-ad291c1d91b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:21.481024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10aba7-15f7-4602-848f-ad291c1d91b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:21.481356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10aba7-15f7-4602-848f-ad291c1d91b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:21.483768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10aba7-15f7-4602-848f-ad291c1d91b8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:21.497666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 105/201] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:21.508272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10aba7-15f7-4602-848f-ad291c1d91b8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:21.555369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 97/202] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:21.562344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069561d-0907-4839-8888-3a7617ed0889 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:21.618125 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10aba7-15f7-4602-848f-ad291c1d91b8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:21.625603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:21.661466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf965-a2c5-402f-bc06-bbad0063ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:21.662145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf965-a2c5-402f-bc06-bbad0063ac8a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:21.663546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf965-a2c5-402f-bc06-bbad0063ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:21.663822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf965-a2c5-402f-bc06-bbad0063ac8a None admin] PATH_INFO: `/v3/users/dbc5534d5cbe43a889cef7d5614775a9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:21.666837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf965-a2c5-402f-bc06-bbad0063ac8a None admin] RBAC: Authorizing `identity:get_user(user_id=dbc5534d5cbe43a889cef7d5614775a9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:21.668293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf965-a2c5-402f-bc06-bbad0063ac8a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:21.675606 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 106/203] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:21 2022] GET /identity/v3/users/dbc5534d5cbe43a889cef7d5614775a9 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:21.694945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf965-a2c5-402f-bc06-bbad0063ac8a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:21.733110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:21.733403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069561d-0907-4839-8888-3a7617ed0889 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:21.805188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07450f56-b24c-40fe-946f-6ec6004acb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:21.806246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450f56-b24c-40fe-946f-6ec6004acb7d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:21.806507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450f56-b24c-40fe-946f-6ec6004acb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:21.806733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450f56-b24c-40fe-946f-6ec6004acb7d None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:21.808002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07450f56-b24c-40fe-946f-6ec6004acb7d None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:21.810168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07450f56-b24c-40fe-946f-6ec6004acb7d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:21.811837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 98/204] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:21 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:21.817838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07450f56-b24c-40fe-946f-6ec6004acb7d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:21.831235 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf965-a2c5-402f-bc06-bbad0063ac8a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:21.881884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2888ad2-2949-49c7-a1de-046400a39570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:21.882924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2888ad2-2949-49c7-a1de-046400a39570 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:21.884891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2888ad2-2949-49c7-a1de-046400a39570 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:21.885405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2888ad2-2949-49c7-a1de-046400a39570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:21.961787 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2888ad2-2949-49c7-a1de-046400a39570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:21.963890 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2888ad2-2949-49c7-a1de-046400a39570 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:21.988536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:22.048892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07450f56-b24c-40fe-946f-6ec6004acb7d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:22.067685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:22.083645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 107/205] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:56:22.093511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2888ad2-2949-49c7-a1de-046400a39570 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:22.126924 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723a0d4-a601-4114-b17f-93c32a8ecfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:22.127562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a0d4-a601-4114-b17f-93c32a8ecfd5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:22.127846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a0d4-a601-4114-b17f-93c32a8ecfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:22.128118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a0d4-a601-4114-b17f-93c32a8ecfd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:22.128872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723a0d4-a601-4114-b17f-93c32a8ecfd5 None admin] RBAC: Adding query filter params (role.id=ee6045909540420b8b406a308fdad516, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c, user.id=2987c8ad7f004e5599404ce2e6caff95) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:22.129209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723a0d4-a601-4114-b17f-93c32a8ecfd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:22.130811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723a0d4-a601-4114-b17f-93c32a8ecfd5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:22.149206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 99/206] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:21 2022] GET /identity/v3/role_assignments?user.id=2987c8ad7f004e5599404ce2e6caff95&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=ee6045909540420b8b406a308fdad516 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:22.241976 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2888ad2-2949-49c7-a1de-046400a39570 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:22.272135 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:22.295759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe018343-907b-4bee-a52f-aee2c1a19e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:22.296832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe018343-907b-4bee-a52f-aee2c1a19e23 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:22.297347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe018343-907b-4bee-a52f-aee2c1a19e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:22.297809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe018343-907b-4bee-a52f-aee2c1a19e23 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:22.299366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe018343-907b-4bee-a52f-aee2c1a19e23 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:22.301095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe018343-907b-4bee-a52f-aee2c1a19e23 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:22.303090 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 108/207] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:22 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:22.309544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723a0d4-a601-4114-b17f-93c32a8ecfd5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:22.468309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723a0d4-a601-4114-b17f-93c32a8ecfd5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:22.503293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b1c80-4bd4-47f0-a794-720ae5324428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:22.504257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b1c80-4bd4-47f0-a794-720ae5324428 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:22.504749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b1c80-4bd4-47f0-a794-720ae5324428 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:22.505256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b1c80-4bd4-47f0-a794-720ae5324428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:22.506237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b1c80-4bd4-47f0-a794-720ae5324428 None admin] RBAC: Adding query filter params (role.id=971973e4c615467dbf11c183a74f5d3a, scope.project.id=cd13a123c9a040d092492aaa25e0225e, user.id=dbc5534d5cbe43a889cef7d5614775a9) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:22.506772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b1c80-4bd4-47f0-a794-720ae5324428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:22.508534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8b1c80-4bd4-47f0-a794-720ae5324428 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:22.514866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 100/208] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:22 2022] GET /identity/v3/role_assignments?user.id=dbc5534d5cbe43a889cef7d5614775a9&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=971973e4c615467dbf11c183a74f5d3a => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:23.554002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f80aea-f121-4bdd-a0ba-aa250721d1c3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:23.555079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f80aea-f121-4bdd-a0ba-aa250721d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:23.555567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f80aea-f121-4bdd-a0ba-aa250721d1c3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:23.557137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 109/209] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:23.562484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea751a-e026-469b-9811-c3a628817a26 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:23.562904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea751a-e026-469b-9811-c3a628817a26 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:23.563083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea751a-e026-469b-9811-c3a628817a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:23.581569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-faea751a-e026-469b-9811-c3a628817a26 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:23.582760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-faea751a-e026-469b-9811-c3a628817a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:23.612369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:23.612687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72933b7-f2c2-42a9-9c94-2b5304c5707f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:23.612975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72933b7-f2c2-42a9-9c94-2b5304c5707f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:23.613293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72933b7-f2c2-42a9-9c94-2b5304c5707f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:23.615402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 110/210] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:56:23.622321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caae7-8e7b-4fb9-9a25-7778ff59e46e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:23.622606 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caae7-8e7b-4fb9-9a25-7778ff59e46e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:23.622882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caae7-8e7b-4fb9-9a25-7778ff59e46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:23.642776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fd7caae7-8e7b-4fb9-9a25-7778ff59e46e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:23.644019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fd7caae7-8e7b-4fb9-9a25-7778ff59e46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:23.667422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 101/211] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:23.713711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 111/212] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:23.754596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782e4f-f6cd-4e91-b1ce-e6620aa31824 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:23.754937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782e4f-f6cd-4e91-b1ce-e6620aa31824 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:23.755237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782e4f-f6cd-4e91-b1ce-e6620aa31824 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:23.757003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 102/213] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:23.762278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38239e6-b1e5-474d-b534-8905998a1c0c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:23.762792 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38239e6-b1e5-474d-b534-8905998a1c0c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:23.763262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38239e6-b1e5-474d-b534-8905998a1c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:23.781908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b38239e6-b1e5-474d-b534-8905998a1c0c None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:23.783374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b38239e6-b1e5-474d-b534-8905998a1c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:23.850345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 112/214] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:23.940443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782e4f-f6cd-4e91-b1ce-e6620aa31824 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.002395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38239e6-b1e5-474d-b534-8905998a1c0c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.045603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782e4f-f6cd-4e91-b1ce-e6620aa31824 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:24.053887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:24.081982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3066a-b7f9-47fd-8f01-75bb04081f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:24.083028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3066a-b7f9-47fd-8f01-75bb04081f22 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.083591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3066a-b7f9-47fd-8f01-75bb04081f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.083865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3066a-b7f9-47fd-8f01-75bb04081f22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.095047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3066a-b7f9-47fd-8f01-75bb04081f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-56a3066a-b7f9-47fd-8f01-75bb04081f22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:24.100072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:24.101003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:24.101826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 103/215] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:56:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:24.108440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3066a-b7f9-47fd-8f01-75bb04081f22 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.112688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38239e6-b1e5-474d-b534-8905998a1c0c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:24.139975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:24.156358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6430d-1dc9-4104-8732-de9bade714ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:24.157218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6430d-1dc9-4104-8732-de9bade714ea None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.157504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6430d-1dc9-4104-8732-de9bade714ea None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.157783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6430d-1dc9-4104-8732-de9bade714ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.158897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6430d-1dc9-4104-8732-de9bade714ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:24.160696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6430d-1dc9-4104-8732-de9bade714ea None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:24.162579 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 113/216] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:24.163136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6430d-1dc9-4104-8732-de9bade714ea None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.219610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3066a-b7f9-47fd-8f01-75bb04081f22 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:24.255469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c162b8-0a81-446a-befb-c9ea133ea3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:24.256202 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c162b8-0a81-446a-befb-c9ea133ea3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.256469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c162b8-0a81-446a-befb-c9ea133ea3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.256738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c162b8-0a81-446a-befb-c9ea133ea3d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.257431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c162b8-0a81-446a-befb-c9ea133ea3d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:24.257733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c162b8-0a81-446a-befb-c9ea133ea3d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:24.259098 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c162b8-0a81-446a-befb-c9ea133ea3d0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:24.267519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 104/217] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:24.268124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c162b8-0a81-446a-befb-c9ea133ea3d0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.269839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6430d-1dc9-4104-8732-de9bade714ea None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:24.290053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:24.309352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3be15b-992a-465d-94f5-ad8d185e9ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:24.309994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3be15b-992a-465d-94f5-ad8d185e9ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.310277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3be15b-992a-465d-94f5-ad8d185e9ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.310547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3be15b-992a-465d-94f5-ad8d185e9ca7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.320836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3be15b-992a-465d-94f5-ad8d185e9ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-bf3be15b-992a-465d-94f5-ad8d185e9ca7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:24.325769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:24.326655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:24.327439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:24.331800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 114/218] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:24.332558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3be15b-992a-465d-94f5-ad8d185e9ca7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.364605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:24.378148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c162b8-0a81-446a-befb-c9ea133ea3d0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:24.414524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0c692-0ece-4369-a560-18c850495d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:24.415136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0c692-0ece-4369-a560-18c850495d64 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.415416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0c692-0ece-4369-a560-18c850495d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.415688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0c692-0ece-4369-a560-18c850495d64 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.416335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0c692-0ece-4369-a560-18c850495d64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:24.417813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0c692-0ece-4369-a560-18c850495d64 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:24.441296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3be15b-992a-465d-94f5-ad8d185e9ca7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:24.453064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 105/219] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:56:24 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:56:24.453064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0c692-0ece-4369-a560-18c850495d64 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.497806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e6fed-1927-4491-8846-afb6b4ef2a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:24.498708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e6fed-1927-4491-8846-afb6b4ef2a6c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.499059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e6fed-1927-4491-8846-afb6b4ef2a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.499381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e6fed-1927-4491-8846-afb6b4ef2a6c None admin] PATH_INFO: `/v3/users/2987c8ad7f004e5599404ce2e6caff95` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.500661 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e6fed-1927-4491-8846-afb6b4ef2a6c None admin] RBAC: Authorizing `identity:get_user(user_id=2987c8ad7f004e5599404ce2e6caff95)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:24.502279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e6fed-1927-4491-8846-afb6b4ef2a6c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:24.504292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 115/220] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:24 2022] GET /identity/v3/users/2987c8ad7f004e5599404ce2e6caff95 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:24.510565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e6fed-1927-4491-8846-afb6b4ef2a6c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.568595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:24.598973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0c692-0ece-4369-a560-18c850495d64 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:24.630973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e6fed-1927-4491-8846-afb6b4ef2a6c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:24.636313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7723a3-4c62-436b-8261-f7980c6a6196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:24.636949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7723a3-4c62-436b-8261-f7980c6a6196 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.637262 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7723a3-4c62-436b-8261-f7980c6a6196 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.637533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7723a3-4c62-436b-8261-f7980c6a6196 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.638215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7723a3-4c62-436b-8261-f7980c6a6196 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:24.639033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7723a3-4c62-436b-8261-f7980c6a6196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:24.640803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7723a3-4c62-436b-8261-f7980c6a6196 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:24.651669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 106/221] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:24.657729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d6e5-1114-44d9-99c2-fefad3647df5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.658005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d6e5-1114-44d9-99c2-fefad3647df5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.658280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d6e5-1114-44d9-99c2-fefad3647df5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.660536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 107/222] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:24.665189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d6e5-1114-44d9-99c2-fefad3647df5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.670789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:24.673796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff6bd6-1a43-4ab9-ab2b-124241c88b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:24.674450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff6bd6-1a43-4ab9-ab2b-124241c88b61 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.674734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff6bd6-1a43-4ab9-ab2b-124241c88b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.675008 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff6bd6-1a43-4ab9-ab2b-124241c88b61 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.676887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff6bd6-1a43-4ab9-ab2b-124241c88b61 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:24.678570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff6bd6-1a43-4ab9-ab2b-124241c88b61 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:24.684915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 116/223] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:24 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:24.684915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b6186-f218-43f2-85a1-c97433f558ce None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.684915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b6186-f218-43f2-85a1-c97433f558ce None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.684915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b6186-f218-43f2-85a1-c97433f558ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.700381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-520b6186-f218-43f2-85a1-c97433f558ce None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:24.701617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-520b6186-f218-43f2-85a1-c97433f558ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:24.793592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 117/224] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:24.794095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d6e5-1114-44d9-99c2-fefad3647df5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:24.795023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b6186-f218-43f2-85a1-c97433f558ce None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.845430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39de88-0310-4059-994d-bc58988b4294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:24.846792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39de88-0310-4059-994d-bc58988b4294 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.847239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39de88-0310-4059-994d-bc58988b4294 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.848701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39de88-0310-4059-994d-bc58988b4294 None admin] PATH_INFO: `/v3/users/f4aec042415745678dfa08a941881c80` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.859068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:24.866702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39de88-0310-4059-994d-bc58988b4294 None admin] RBAC: Authorizing `identity:get_user(user_id=f4aec042415745678dfa08a941881c80)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:24.869056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39de88-0310-4059-994d-bc58988b4294 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:24.871955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 108/225] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:24 2022] GET /identity/v3/users/f4aec042415745678dfa08a941881c80 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:24.877454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39de88-0310-4059-994d-bc58988b4294 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:24.926436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b6186-f218-43f2-85a1-c97433f558ce None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:24.946698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:24.983567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a1c2-bd40-4077-9cb6-2e599b544699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:24.984817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a1c2-bd40-4077-9cb6-2e599b544699 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:24.986148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a1c2-bd40-4077-9cb6-2e599b544699 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:24.989208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a1c2-bd40-4077-9cb6-2e599b544699 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/users/2987c8ad7f004e5599404ce2e6caff95/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:24.991584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99a1c2-bd40-4077-9cb6-2e599b544699 None admin] RBAC: Authorizing `identity:create_grant(project_id=237f2ccd89da4522952fcbe9127d4d2c, user_id=2987c8ad7f004e5599404ce2e6caff95, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:24.993402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99a1c2-bd40-4077-9cb6-2e599b544699 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:25.015013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39de88-0310-4059-994d-bc58988b4294 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:25.017586 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 118/226] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:56:24 2022] PUT /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/users/2987c8ad7f004e5599404ce2e6caff95/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:25.069594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c603fdc-d520-4e68-893c-c37f35b04870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:25.070641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c603fdc-d520-4e68-893c-c37f35b04870 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:25.071175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c603fdc-d520-4e68-893c-c37f35b04870 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:25.071633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c603fdc-d520-4e68-893c-c37f35b04870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:25.168709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c603fdc-d520-4e68-893c-c37f35b04870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:25.170303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c603fdc-d520-4e68-893c-c37f35b04870 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:25.187234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a1c2-bd40-4077-9cb6-2e599b544699 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:25.238869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:25.284400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 109/227] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:25.291030 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c603fdc-d520-4e68-893c-c37f35b04870 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:25.356775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a1c2-bd40-4077-9cb6-2e599b544699 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:25.359553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:25.419387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d55f87-a010-4253-af2c-12ad7f858960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:25.420036 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d55f87-a010-4253-af2c-12ad7f858960 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:25.420322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d55f87-a010-4253-af2c-12ad7f858960 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:25.420587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d55f87-a010-4253-af2c-12ad7f858960 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:25.441468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d55f87-a010-4253-af2c-12ad7f858960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-95d55f87-a010-4253-af2c-12ad7f858960 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:25.450025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:25.450894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:25.451662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 119/228] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:25.459253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d55f87-a010-4253-af2c-12ad7f858960 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:25.485463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c603fdc-d520-4e68-893c-c37f35b04870 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:25.558309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbcfa6-7b65-429e-a327-17d481ca8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:25.561320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbcfa6-7b65-429e-a327-17d481ca8e71 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:25.561940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbcfa6-7b65-429e-a327-17d481ca8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:25.562959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbcfa6-7b65-429e-a327-17d481ca8e71 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:25.565805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbcfa6-7b65-429e-a327-17d481ca8e71 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:25.567287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbcfa6-7b65-429e-a327-17d481ca8e71 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:25.573873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 110/229] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:25 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:25.575018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbcfa6-7b65-429e-a327-17d481ca8e71 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:25.630964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:25.634195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d55f87-a010-4253-af2c-12ad7f858960 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:25.703207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517dc03-6a8f-4f04-9a2b-8d9744eda6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:25.703745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517dc03-6a8f-4f04-9a2b-8d9744eda6bc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:25.704025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517dc03-6a8f-4f04-9a2b-8d9744eda6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:25.704296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517dc03-6a8f-4f04-9a2b-8d9744eda6bc None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:25.704979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517dc03-6a8f-4f04-9a2b-8d9744eda6bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:25.705306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517dc03-6a8f-4f04-9a2b-8d9744eda6bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:25.706719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517dc03-6a8f-4f04-9a2b-8d9744eda6bc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:25.722025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbcfa6-7b65-429e-a327-17d481ca8e71 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:25.731447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 120/230] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:25.738508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517dc03-6a8f-4f04-9a2b-8d9744eda6bc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:25.762623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f393fe-d58d-464f-8255-5593151e3644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:25.763256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f393fe-d58d-464f-8255-5593151e3644 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:25.763510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f393fe-d58d-464f-8255-5593151e3644 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:25.763777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f393fe-d58d-464f-8255-5593151e3644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:25.764556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f393fe-d58d-464f-8255-5593151e3644 None admin] RBAC: Adding query filter params (role.id=b86a73fa9cc046eeae600bffd4218e7b, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c, user.id=f4aec042415745678dfa08a941881c80) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:25.764866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f393fe-d58d-464f-8255-5593151e3644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:25.769882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f393fe-d58d-464f-8255-5593151e3644 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:25.783305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 111/231] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:25 2022] GET /identity/v3/role_assignments?user.id=f4aec042415745678dfa08a941881c80&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:25.784738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:25.912537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517dc03-6a8f-4f04-9a2b-8d9744eda6bc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:25.966543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf350b80-f230-45e2-be20-c8fdde782058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:25.967124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf350b80-f230-45e2-be20-c8fdde782058 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:25.967409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf350b80-f230-45e2-be20-c8fdde782058 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:25.967679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf350b80-f230-45e2-be20-c8fdde782058 None admin] PATH_INFO: `/v3/users/2987c8ad7f004e5599404ce2e6caff95` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:25.968871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf350b80-f230-45e2-be20-c8fdde782058 None admin] RBAC: Authorizing `identity:get_user(user_id=2987c8ad7f004e5599404ce2e6caff95)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:25.970389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf350b80-f230-45e2-be20-c8fdde782058 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:25.972280 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 121/232] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:25 2022] GET /identity/v3/users/2987c8ad7f004e5599404ce2e6caff95 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:25.978370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f393fe-d58d-464f-8255-5593151e3644 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:26.102518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:26.110442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f393fe-d58d-464f-8255-5593151e3644 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:26.154368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3f2b9-1181-465e-9e71-4ea08308a8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:26.155025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3f2b9-1181-465e-9e71-4ea08308a8dd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:26.155304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3f2b9-1181-465e-9e71-4ea08308a8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:26.155574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3f2b9-1181-465e-9e71-4ea08308a8dd None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:26.156762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3f2b9-1181-465e-9e71-4ea08308a8dd None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:26.158309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3f2b9-1181-465e-9e71-4ea08308a8dd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:26.160243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 112/233] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:25 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:26.165748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf350b80-f230-45e2-be20-c8fdde782058 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:26.311443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:26.321270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf350b80-f230-45e2-be20-c8fdde782058 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:26.366638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc08415-410d-4ef5-9c07-42d8a4466710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:26.367307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc08415-410d-4ef5-9c07-42d8a4466710 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:26.367580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc08415-410d-4ef5-9c07-42d8a4466710 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:26.367915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc08415-410d-4ef5-9c07-42d8a4466710 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/users/2987c8ad7f004e5599404ce2e6caff95/roles/ee6045909540420b8b406a308fdad516` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:26.370206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc08415-410d-4ef5-9c07-42d8a4466710 None admin] RBAC: Authorizing `identity:create_grant(project_id=237f2ccd89da4522952fcbe9127d4d2c, user_id=2987c8ad7f004e5599404ce2e6caff95, role_id=ee6045909540420b8b406a308fdad516)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:26.371651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc08415-410d-4ef5-9c07-42d8a4466710 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:26.402378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 122/234] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:56:26 2022] PUT /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/users/2987c8ad7f004e5599404ce2e6caff95/roles/ee6045909540420b8b406a308fdad516 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:27.276895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673270-118a-432e-84cb-67fbf4bea3d4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:27.277434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673270-118a-432e-84cb-67fbf4bea3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:27.277434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77673270-118a-432e-84cb-67fbf4bea3d4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:27.278951 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 113/235] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:27.285547 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4c87c-47ee-41ae-b273-8d4eb371ccc6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:27.285834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4c87c-47ee-41ae-b273-8d4eb371ccc6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:27.286105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4c87c-47ee-41ae-b273-8d4eb371ccc6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:27.287722 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 114/236] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:56:27.288197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a74c2d-7c6e-4cd8-8b16-601355125808 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:27.288607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a74c2d-7c6e-4cd8-8b16-601355125808 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:27.288773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a74c2d-7c6e-4cd8-8b16-601355125808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:27.294059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee924-2884-4a43-bb3f-6f568e082bcf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:27.294574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee924-2884-4a43-bb3f-6f568e082bcf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:27.295049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee924-2884-4a43-bb3f-6f568e082bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:27.315830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-102ee924-2884-4a43-bb3f-6f568e082bcf None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:27.317439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-102ee924-2884-4a43-bb3f-6f568e082bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:27.318032 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a5a74c2d-7c6e-4cd8-8b16-601355125808 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:27.319311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a5a74c2d-7c6e-4cd8-8b16-601355125808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:27.433177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 115/237] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:27.443984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 123/238] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:27.564398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24870906-8b42-47e9-a935-10359e40de76 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:27.565055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24870906-8b42-47e9-a935-10359e40de76 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:27.565534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24870906-8b42-47e9-a935-10359e40de76 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:27.567105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 116/239] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:56:27.572915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962e28-706e-4f05-b0e0-8c935757f761 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:27.573473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962e28-706e-4f05-b0e0-8c935757f761 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:27.573964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962e28-706e-4f05-b0e0-8c935757f761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:27.595098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fc962e28-706e-4f05-b0e0-8c935757f761 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:27.596618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fc962e28-706e-4f05-b0e0-8c935757f761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:27.689156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 124/240] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:27.877643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24870906-8b42-47e9-a935-10359e40de76 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:27.888610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962e28-706e-4f05-b0e0-8c935757f761 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:27.915012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:28.014076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962e28-706e-4f05-b0e0-8c935757f761 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:28.039478 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:28.056109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24870906-8b42-47e9-a935-10359e40de76 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:28.061366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60703e92-652e-4cf6-8d77-2ee8fcfc1a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:28.062228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703e92-652e-4cf6-8d77-2ee8fcfc1a48 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.062653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703e92-652e-4cf6-8d77-2ee8fcfc1a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.063065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60703e92-652e-4cf6-8d77-2ee8fcfc1a48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.074288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60703e92-652e-4cf6-8d77-2ee8fcfc1a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-60703e92-652e-4cf6-8d77-2ee8fcfc1a48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:28.079501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:28.080379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:28.081194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:28.083530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 125/241] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:28.084600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60703e92-652e-4cf6-8d77-2ee8fcfc1a48 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:28.096432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38944338-31d5-45b5-a0e2-0ee214248dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:28.097235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38944338-31d5-45b5-a0e2-0ee214248dcd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.097592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38944338-31d5-45b5-a0e2-0ee214248dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.097934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38944338-31d5-45b5-a0e2-0ee214248dcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.099538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38944338-31d5-45b5-a0e2-0ee214248dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:28.101347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38944338-31d5-45b5-a0e2-0ee214248dcd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:28.103334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 117/242] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:28.104181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38944338-31d5-45b5-a0e2-0ee214248dcd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:28.186920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:28.238180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60703e92-652e-4cf6-8d77-2ee8fcfc1a48 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:28.255661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38944338-31d5-45b5-a0e2-0ee214248dcd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:28.283388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24965b7-da98-4a4c-82ef-4b5c30c9ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:28.283919 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24965b7-da98-4a4c-82ef-4b5c30c9ed1d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.284203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24965b7-da98-4a4c-82ef-4b5c30c9ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.284473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24965b7-da98-4a4c-82ef-4b5c30c9ed1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.295039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24965b7-da98-4a4c-82ef-4b5c30c9ed1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:28.297697 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84165c-6b9a-43f9-8de6-54a91cadabe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:28.298784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84165c-6b9a-43f9-8de6-54a91cadabe8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.299239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84165c-6b9a-43f9-8de6-54a91cadabe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.299688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84165c-6b9a-43f9-8de6-54a91cadabe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e24965b7-da98-4a4c-82ef-4b5c30c9ed1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:28.299835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:28.300692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:28.301551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 126/243] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:56:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:28.302197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24965b7-da98-4a4c-82ef-4b5c30c9ed1d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:28.303491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84165c-6b9a-43f9-8de6-54a91cadabe8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:28.303804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84165c-6b9a-43f9-8de6-54a91cadabe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:28.305328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84165c-6b9a-43f9-8de6-54a91cadabe8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:28.321067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 118/244] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:28.321067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661993e-5721-4cf0-a932-9c06a9b25f76 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.321067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661993e-5721-4cf0-a932-9c06a9b25f76 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.321067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661993e-5721-4cf0-a932-9c06a9b25f76 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.321067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 119/245] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:28.321067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661993e-5721-4cf0-a932-9c06a9b25f76 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:28.345313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:28.413103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24965b7-da98-4a4c-82ef-4b5c30c9ed1d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:28.423301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661993e-5721-4cf0-a932-9c06a9b25f76 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:28.443048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:28.448902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516c11d-c50d-43f9-a684-5cf6b334081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:28.449655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516c11d-c50d-43f9-a684-5cf6b334081c None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.449934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516c11d-c50d-43f9-a684-5cf6b334081c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.450208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516c11d-c50d-43f9-a684-5cf6b334081c None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.450867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516c11d-c50d-43f9-a684-5cf6b334081c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:28.452331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516c11d-c50d-43f9-a684-5cf6b334081c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:28.459925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c610e6-70db-4d3f-9690-3e997bd20cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:28.460805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c610e6-70db-4d3f-9690-3e997bd20cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.461337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c610e6-70db-4d3f-9690-3e997bd20cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.461808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c610e6-70db-4d3f-9690-3e997bd20cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.462681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c610e6-70db-4d3f-9690-3e997bd20cd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:28.463177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c610e6-70db-4d3f-9690-3e997bd20cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:28.464851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c610e6-70db-4d3f-9690-3e997bd20cd3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:28.474747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 120/247] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:28.475887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c610e6-70db-4d3f-9690-3e997bd20cd3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:28.479406 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 127/247] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:56:28 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:56:28.481001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dbcb6-e37b-4a10-a40e-cf797aa51f25 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.481447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dbcb6-e37b-4a10-a40e-cf797aa51f25 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.481776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dbcb6-e37b-4a10-a40e-cf797aa51f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.500544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-315dbcb6-e37b-4a10-a40e-cf797aa51f25 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:28.501887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-315dbcb6-e37b-4a10-a40e-cf797aa51f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:28.593861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 128/248] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:28.594889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dbcb6-e37b-4a10-a40e-cf797aa51f25 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:28.598277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:28.628595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c610e6-70db-4d3f-9690-3e997bd20cd3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:28.680849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b7228-e207-4135-a886-c33d7e389a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:28.681540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b7228-e207-4135-a886-c33d7e389a02 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.681823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b7228-e207-4135-a886-c33d7e389a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.682100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b7228-e207-4135-a886-c33d7e389a02 None admin] PATH_INFO: `/v3/users/6777a827ce2846dda86f04294159b5ff` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.718539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b7228-e207-4135-a886-c33d7e389a02 None admin] RBAC: Authorizing `identity:get_user(user_id=6777a827ce2846dda86f04294159b5ff)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:28.720380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b7228-e207-4135-a886-c33d7e389a02 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:28.725570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 121/249] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:28 2022] GET /identity/v3/users/6777a827ce2846dda86f04294159b5ff => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:28.728950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b7228-e207-4135-a886-c33d7e389a02 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:28.743473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dbcb6-e37b-4a10-a40e-cf797aa51f25 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:28.774849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:28.791209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf128d51-765d-413a-b164-e3e27aa12c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:28.791867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf128d51-765d-413a-b164-e3e27aa12c50 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.792151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf128d51-765d-413a-b164-e3e27aa12c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.792418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf128d51-765d-413a-b164-e3e27aa12c50 None admin] PATH_INFO: `/v3/users/2987c8ad7f004e5599404ce2e6caff95` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.794076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf128d51-765d-413a-b164-e3e27aa12c50 None admin] RBAC: Authorizing `identity:get_user(user_id=2987c8ad7f004e5599404ce2e6caff95)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:28.796351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf128d51-765d-413a-b164-e3e27aa12c50 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:28.801148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 129/250] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:28 2022] GET /identity/v3/users/2987c8ad7f004e5599404ce2e6caff95 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:28.804849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf128d51-765d-413a-b164-e3e27aa12c50 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:28.862761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b7228-e207-4135-a886-c33d7e389a02 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:28.901434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edd040-02b7-4e46-abe4-a85868ded565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:28.902161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edd040-02b7-4e46-abe4-a85868ded565 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.902554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edd040-02b7-4e46-abe4-a85868ded565 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.902839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edd040-02b7-4e46-abe4-a85868ded565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:28.925162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:28.937439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf128d51-765d-413a-b164-e3e27aa12c50 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:28.997853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f037c-4866-4afc-b29e-edba11e0acb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:28.998604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f037c-4866-4afc-b29e-edba11e0acb2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:28.998958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f037c-4866-4afc-b29e-edba11e0acb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:28.999315 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f037c-4866-4afc-b29e-edba11e0acb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:29.001373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edd040-02b7-4e46-abe4-a85868ded565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:29.004336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edd040-02b7-4e46-abe4-a85868ded565 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:29.073382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:29.091930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f037c-4866-4afc-b29e-edba11e0acb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:29.093901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f037c-4866-4afc-b29e-edba11e0acb2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:29.132764 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 122/251] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:29.133574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edd040-02b7-4e46-abe4-a85868ded565 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:29.192924 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:29.235539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 130/252] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:29.241665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83ee3c-8605-47ef-a6d7-af0b17ca2871 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:29.242084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83ee3c-8605-47ef-a6d7-af0b17ca2871 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:29.242465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83ee3c-8605-47ef-a6d7-af0b17ca2871 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:29.243893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 131/253] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:29.244731 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83ee3c-8605-47ef-a6d7-af0b17ca2871 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:29.256622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edd040-02b7-4e46-abe4-a85868ded565 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:29.304742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314c9f1-9a23-4de8-a13b-d19f2eef2f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:29.305608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314c9f1-9a23-4de8-a13b-d19f2eef2f3e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:29.305984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314c9f1-9a23-4de8-a13b-d19f2eef2f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:29.306375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314c9f1-9a23-4de8-a13b-d19f2eef2f3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:29.318316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314c9f1-9a23-4de8-a13b-d19f2eef2f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8314c9f1-9a23-4de8-a13b-d19f2eef2f3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:29.325231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:29.326119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:29.326889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:29.327479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 123/254] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:29.328893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314c9f1-9a23-4de8-a13b-d19f2eef2f3e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:29.347770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:29.367282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83ee3c-8605-47ef-a6d7-af0b17ca2871 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:29.405594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622cb2f-a130-423a-9514-db697d1605f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:29.406158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622cb2f-a130-423a-9514-db697d1605f3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:29.406440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622cb2f-a130-423a-9514-db697d1605f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:29.406710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622cb2f-a130-423a-9514-db697d1605f3 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:29.408017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622cb2f-a130-423a-9514-db697d1605f3 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:29.409553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622cb2f-a130-423a-9514-db697d1605f3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:29.411653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 132/255] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:29 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:29.413388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18adacb-af48-4e80-aff3-52c9278ac533 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:29.413667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18adacb-af48-4e80-aff3-52c9278ac533 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:29.413935 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18adacb-af48-4e80-aff3-52c9278ac533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:29.432541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a18adacb-af48-4e80-aff3-52c9278ac533 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:29.434037 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a18adacb-af48-4e80-aff3-52c9278ac533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:29.442257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314c9f1-9a23-4de8-a13b-d19f2eef2f3e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:29.445502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:29.479132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101519b-820f-42a9-93ca-08f8cabb929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:29.479778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101519b-820f-42a9-93ca-08f8cabb929c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:29.480058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101519b-820f-42a9-93ca-08f8cabb929c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:29.480332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101519b-820f-42a9-93ca-08f8cabb929c None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:29.481497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101519b-820f-42a9-93ca-08f8cabb929c None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:29.482954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101519b-820f-42a9-93ca-08f8cabb929c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:29.485931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 124/256] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:29 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:29.489903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101519b-820f-42a9-93ca-08f8cabb929c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:29.526673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 133/257] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:29.528435 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18adacb-af48-4e80-aff3-52c9278ac533 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:29.635380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101519b-820f-42a9-93ca-08f8cabb929c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:29.675199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:29.711870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22db8a5-d934-4b40-86e4-75cc7538a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:29.712495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db8a5-d934-4b40-86e4-75cc7538a308 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:29.712771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db8a5-d934-4b40-86e4-75cc7538a308 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:29.713062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db8a5-d934-4b40-86e4-75cc7538a308 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:29.713736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22db8a5-d934-4b40-86e4-75cc7538a308 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:29.714038 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22db8a5-d934-4b40-86e4-75cc7538a308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:29.715855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22db8a5-d934-4b40-86e4-75cc7538a308 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:29.730019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18adacb-af48-4e80-aff3-52c9278ac533 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:29.738856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 125/258] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:29.739642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22db8a5-d934-4b40-86e4-75cc7538a308 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:29.791382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e8082-8586-4d16-bb85-6ab57da9ef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:29.792003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8082-8586-4d16-bb85-6ab57da9ef4f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:29.792275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8082-8586-4d16-bb85-6ab57da9ef4f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:29.792547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e8082-8586-4d16-bb85-6ab57da9ef4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:29.793311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e8082-8586-4d16-bb85-6ab57da9ef4f None admin] RBAC: Adding query filter params (role.id=971973e4c615467dbf11c183a74f5d3a, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c, user.id=6777a827ce2846dda86f04294159b5ff) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:29.793616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e8082-8586-4d16-bb85-6ab57da9ef4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:29.795078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e8082-8586-4d16-bb85-6ab57da9ef4f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:29.799050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:29.806926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 134/259] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:29 2022] GET /identity/v3/role_assignments?user.id=6777a827ce2846dda86f04294159b5ff&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=971973e4c615467dbf11c183a74f5d3a => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:29.808523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e8082-8586-4d16-bb85-6ab57da9ef4f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:29.912182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22db8a5-d934-4b40-86e4-75cc7538a308 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:29.963312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93c52-7137-4307-a3ef-8dcabc29b6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:29.963911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93c52-7137-4307-a3ef-8dcabc29b6df None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:29.964189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93c52-7137-4307-a3ef-8dcabc29b6df None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:29.964460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a93c52-7137-4307-a3ef-8dcabc29b6df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:29.965258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a93c52-7137-4307-a3ef-8dcabc29b6df None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c, user.id=2987c8ad7f004e5599404ce2e6caff95) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:29.965573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a93c52-7137-4307-a3ef-8dcabc29b6df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:29.967386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a93c52-7137-4307-a3ef-8dcabc29b6df None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:29.987215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 126/260] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:29 2022] GET /identity/v3/role_assignments?user.id=2987c8ad7f004e5599404ce2e6caff95&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=77285ef607e34662b6234656fe8043d0 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:29.988328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93c52-7137-4307-a3ef-8dcabc29b6df None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:30.033802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e8082-8586-4d16-bb85-6ab57da9ef4f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:30.092359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae5a1e-98d5-4c83-8bdc-5102edc0f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:30.093119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5a1e-98d5-4c83-8bdc-5102edc0f1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:30.093406 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5a1e-98d5-4c83-8bdc-5102edc0f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:30.093745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae5a1e-98d5-4c83-8bdc-5102edc0f1f1 None admin] PATH_INFO: `/v3/users/f4aec042415745678dfa08a941881c80` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:30.094974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae5a1e-98d5-4c83-8bdc-5102edc0f1f1 None admin] RBAC: Authorizing `identity:get_user(user_id=f4aec042415745678dfa08a941881c80)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:30.096568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae5a1e-98d5-4c83-8bdc-5102edc0f1f1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:30.098272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 135/261] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:29 2022] GET /identity/v3/users/f4aec042415745678dfa08a941881c80 => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:30.104745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae5a1e-98d5-4c83-8bdc-5102edc0f1f1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:30.126969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:30.151125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:30.156293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a93c52-7137-4307-a3ef-8dcabc29b6df None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:30.216206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d99bc-456a-4d6c-882e-ad16469c142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:30.217978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d99bc-456a-4d6c-882e-ad16469c142d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:30.219111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d99bc-456a-4d6c-882e-ad16469c142d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:30.219596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d99bc-456a-4d6c-882e-ad16469c142d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:30.248144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d99bc-456a-4d6c-882e-ad16469c142d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ab9d99bc-456a-4d6c-882e-ad16469c142d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:30.254013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:30.255114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:30.256282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:30.261062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 127/262] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:30.270380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d99bc-456a-4d6c-882e-ad16469c142d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:30.307394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae5a1e-98d5-4c83-8bdc-5102edc0f1f1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:30.382357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1a04-4ed7-4191-9a5b-a278df275782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:30.384743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1a04-4ed7-4191-9a5b-a278df275782 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:30.385878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1a04-4ed7-4191-9a5b-a278df275782 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:30.386547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1a04-4ed7-4191-9a5b-a278df275782 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:30.390302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c1a04-4ed7-4191-9a5b-a278df275782 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:30.393446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c1a04-4ed7-4191-9a5b-a278df275782 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:30.397196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 136/263] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:30 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:30.401433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1a04-4ed7-4191-9a5b-a278df275782 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:30.440471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d99bc-456a-4d6c-882e-ad16469c142d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:30.509762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536958be-d270-4b8a-8830-7bfa75655bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:30.510387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536958be-d270-4b8a-8830-7bfa75655bbf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:30.510668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536958be-d270-4b8a-8830-7bfa75655bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:30.510941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536958be-d270-4b8a-8830-7bfa75655bbf None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:30.511617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536958be-d270-4b8a-8830-7bfa75655bbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:30.511922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536958be-d270-4b8a-8830-7bfa75655bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:30.515964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536958be-d270-4b8a-8830-7bfa75655bbf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:30.529105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 128/264] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:30.535766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536958be-d270-4b8a-8830-7bfa75655bbf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:30.569424 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:30.579249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:30.606408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1a04-4ed7-4191-9a5b-a278df275782 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:30.684973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882b2e-b25e-46b9-90b5-635f3431597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:30.686067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882b2e-b25e-46b9-90b5-635f3431597c None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:30.686575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882b2e-b25e-46b9-90b5-635f3431597c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:30.687042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882b2e-b25e-46b9-90b5-635f3431597c None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/users/f4aec042415745678dfa08a941881c80/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:30.695659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20882b2e-b25e-46b9-90b5-635f3431597c None admin] RBAC: Authorizing `identity:create_grant(project_id=237f2ccd89da4522952fcbe9127d4d2c, user_id=f4aec042415745678dfa08a941881c80, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:30.697419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20882b2e-b25e-46b9-90b5-635f3431597c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:30.713530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536958be-d270-4b8a-8830-7bfa75655bbf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:30.735178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 137/265] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:56:30 2022] PUT /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/users/f4aec042415745678dfa08a941881c80/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:30.760527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b5975-e954-431a-8cd4-9be32eb68708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:30.761132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b5975-e954-431a-8cd4-9be32eb68708 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:30.761418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b5975-e954-431a-8cd4-9be32eb68708 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:30.761693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b5975-e954-431a-8cd4-9be32eb68708 None admin] PATH_INFO: `/v3/users/2987c8ad7f004e5599404ce2e6caff95` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:30.766069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b5975-e954-431a-8cd4-9be32eb68708 None admin] RBAC: Authorizing `identity:get_user(user_id=2987c8ad7f004e5599404ce2e6caff95)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:30.767662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b5975-e954-431a-8cd4-9be32eb68708 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:30.769797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 129/266] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:30 2022] GET /identity/v3/users/2987c8ad7f004e5599404ce2e6caff95 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:30.777178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882b2e-b25e-46b9-90b5-635f3431597c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:30.915899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882b2e-b25e-46b9-90b5-635f3431597c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:30.961937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb7809-89af-4c57-9b53-537e32d1c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:30.962565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb7809-89af-4c57-9b53-537e32d1c822 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:30.962840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb7809-89af-4c57-9b53-537e32d1c822 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:30.963107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb7809-89af-4c57-9b53-537e32d1c822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:30.980426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:31.051569 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb7809-89af-4c57-9b53-537e32d1c822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:31.053063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb7809-89af-4c57-9b53-537e32d1c822 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:31.194035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 138/267] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:31.200127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b5975-e954-431a-8cd4-9be32eb68708 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:31.246217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a20c-da85-4bbe-80ed-028a16c7e834 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:31.246550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a20c-da85-4bbe-80ed-028a16c7e834 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:31.246734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a20c-da85-4bbe-80ed-028a16c7e834 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:31.248235 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 139/268] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:31.253749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbfe28-c9d1-4b64-b50a-ca29eadf7c91 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:31.253999 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbfe28-c9d1-4b64-b50a-ca29eadf7c91 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:31.254253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbfe28-c9d1-4b64-b50a-ca29eadf7c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:31.277236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9ddbfe28-c9d1-4b64-b50a-ca29eadf7c91 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:31.278721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9ddbfe28-c9d1-4b64-b50a-ca29eadf7c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:31.345500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:31.367086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:31.371648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b5975-e954-431a-8cd4-9be32eb68708 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:31.417565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 140/269] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:31.424176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e80d7e-d7e6-41e4-ac2a-401ba187c435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:31.424872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e80d7e-d7e6-41e4-ac2a-401ba187c435 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:31.425175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e80d7e-d7e6-41e4-ac2a-401ba187c435 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:31.425442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e80d7e-d7e6-41e4-ac2a-401ba187c435 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:31.426584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e80d7e-d7e6-41e4-ac2a-401ba187c435 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:31.428111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e80d7e-d7e6-41e4-ac2a-401ba187c435 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:31.430304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 130/270] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:31 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:31.438196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbfe28-c9d1-4b64-b50a-ca29eadf7c91 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:31.463423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426b746-0aba-4bcc-be55-ebfd513584dc None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:31.463926 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426b746-0aba-4bcc-be55-ebfd513584dc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:31.464028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426b746-0aba-4bcc-be55-ebfd513584dc None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:31.465405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 131/271] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:56:31.471403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562662e-125e-467f-8bb4-180acbae55b7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:31.471693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562662e-125e-467f-8bb4-180acbae55b7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:31.471973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562662e-125e-467f-8bb4-180acbae55b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:31.492065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3562662e-125e-467f-8bb4-180acbae55b7 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:31.493313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3562662e-125e-467f-8bb4-180acbae55b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:31.569168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 132/272] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:31.615889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbfe28-c9d1-4b64-b50a-ca29eadf7c91 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:31.662681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c9341-bb85-4785-ba80-a97b63ad9e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:31.663301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c9341-bb85-4785-ba80-a97b63ad9e97 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:31.663585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c9341-bb85-4785-ba80-a97b63ad9e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:31.663851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c9341-bb85-4785-ba80-a97b63ad9e97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:31.664588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c9341-bb85-4785-ba80-a97b63ad9e97 None admin] RBAC: Adding query filter params (role.id=ee6045909540420b8b406a308fdad516, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c, user.id=2987c8ad7f004e5599404ce2e6caff95) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:31.664891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c9341-bb85-4785-ba80-a97b63ad9e97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:31.666386 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c9341-bb85-4785-ba80-a97b63ad9e97 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:31.672442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 141/273] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:31 2022] GET /identity/v3/role_assignments?user.id=2987c8ad7f004e5599404ce2e6caff95&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=ee6045909540420b8b406a308fdad516 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:31.701820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562662e-125e-467f-8bb4-180acbae55b7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:31.825212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:31.846778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562662e-125e-467f-8bb4-180acbae55b7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:31.889554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595699c-71c8-49b7-825a-fe5f1b27a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:31.890550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595699c-71c8-49b7-825a-fe5f1b27a915 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:31.891025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595699c-71c8-49b7-825a-fe5f1b27a915 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:31.891488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595699c-71c8-49b7-825a-fe5f1b27a915 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:31.904117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595699c-71c8-49b7-825a-fe5f1b27a915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6595699c-71c8-49b7-825a-fe5f1b27a915 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:31.909238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:31.910085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:31.910861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:31.913486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 133/274] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:31.919524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c9341-bb85-4785-ba80-a97b63ad9e97 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:31.960742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595699c-71c8-49b7-825a-fe5f1b27a915 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:31.964653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:32.044155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c9341-bb85-4785-ba80-a97b63ad9e97 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:32.093750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595699c-71c8-49b7-825a-fe5f1b27a915 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:32.102759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffebf5a-d0db-40bd-a105-7c9cf286ad39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:32.103653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffebf5a-d0db-40bd-a105-7c9cf286ad39 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:32.104130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffebf5a-d0db-40bd-a105-7c9cf286ad39 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:32.104641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffebf5a-d0db-40bd-a105-7c9cf286ad39 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:32.105895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffebf5a-d0db-40bd-a105-7c9cf286ad39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:32.107436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffebf5a-d0db-40bd-a105-7c9cf286ad39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:32.110160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffebf5a-d0db-40bd-a105-7c9cf286ad39 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:32.126077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 142/275] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:32.127308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffebf5a-d0db-40bd-a105-7c9cf286ad39 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:32.143896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e7fd6-c97f-4bba-92fa-afa959031451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:32.144793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e7fd6-c97f-4bba-92fa-afa959031451 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:32.145319 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e7fd6-c97f-4bba-92fa-afa959031451 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:32.146173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e7fd6-c97f-4bba-92fa-afa959031451 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:32.147648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e7fd6-c97f-4bba-92fa-afa959031451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:32.149363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e7fd6-c97f-4bba-92fa-afa959031451 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:32.151181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 134/276] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:32.158777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e7fd6-c97f-4bba-92fa-afa959031451 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:32.176530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:32.266885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:32.270281 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffebf5a-d0db-40bd-a105-7c9cf286ad39 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:32.274982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e7fd6-c97f-4bba-92fa-afa959031451 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:32.315502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aa235-9151-47c4-844b-8f5383cbf6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:32.315790 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03647e-1232-4451-8650-53697a5e3f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:32.316528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03647e-1232-4451-8650-53697a5e3f6f None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:32.316821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa235-9151-47c4-844b-8f5383cbf6fe None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:32.316920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03647e-1232-4451-8650-53697a5e3f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:32.317246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03647e-1232-4451-8650-53697a5e3f6f None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:32.317585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa235-9151-47c4-844b-8f5383cbf6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:32.318028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03647e-1232-4451-8650-53697a5e3f6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:32.318231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa235-9151-47c4-844b-8f5383cbf6fe None admin] PATH_INFO: `/v3/users/5fa3073111314a76992af1e359df7c95` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:32.319943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03647e-1232-4451-8650-53697a5e3f6f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:32.335650 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aa235-9151-47c4-844b-8f5383cbf6fe None admin] RBAC: Authorizing `identity:get_user(user_id=5fa3073111314a76992af1e359df7c95)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:32.337362 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aa235-9151-47c4-844b-8f5383cbf6fe None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:32.344500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 143/277] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:32 2022] GET /identity/v3/users/5fa3073111314a76992af1e359df7c95 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:32.345457 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aa235-9151-47c4-844b-8f5383cbf6fe None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:32.347762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 135/278] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:56:32 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:56:32.464423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aa235-9151-47c4-844b-8f5383cbf6fe None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:32.505051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2e191-0932-4f86-80ad-d86273672f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:32.505754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2e191-0932-4f86-80ad-d86273672f68 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:32.506040 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2e191-0932-4f86-80ad-d86273672f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:32.506312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2e191-0932-4f86-80ad-d86273672f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:32.507058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2e191-0932-4f86-80ad-d86273672f68 None admin] RBAC: Adding query filter params (role.id=b86a73fa9cc046eeae600bffd4218e7b, user.id=5fa3073111314a76992af1e359df7c95, scope.system=all) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:32.507432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2e191-0932-4f86-80ad-d86273672f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:32.508917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2e191-0932-4f86-80ad-d86273672f68 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:32.514972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 144/279] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Sep 19 16:56:32 2022] GET /identity/v3/role_assignments?user.id=5fa3073111314a76992af1e359df7c95&scope.system=all&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:32.585463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e7a93-8479-4d63-bca3-2b4c81c3fbd4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:32.585988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e7a93-8479-4d63-bca3-2b4c81c3fbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:32.585988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e7a93-8479-4d63-bca3-2b4c81c3fbd4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:32.587724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 136/280] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:32.593477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9883572-ade2-48a7-9a1a-a3dc346a9790 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:32.593760 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9883572-ade2-48a7-9a1a-a3dc346a9790 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:32.594062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9883572-ade2-48a7-9a1a-a3dc346a9790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:32.614341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f9883572-ade2-48a7-9a1a-a3dc346a9790 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:32.616082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f9883572-ade2-48a7-9a1a-a3dc346a9790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:32.635802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:32.694232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 145/281] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:32.963651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e7a93-8479-4d63-bca3-2b4c81c3fbd4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:33.041441 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:33.077155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e7a93-8479-4d63-bca3-2b4c81c3fbd4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:33.111762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733f6b9-e20b-4197-877d-16033b65c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:33.112418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733f6b9-e20b-4197-877d-16033b65c801 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:33.112750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733f6b9-e20b-4197-877d-16033b65c801 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:33.113027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733f6b9-e20b-4197-877d-16033b65c801 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:33.125743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733f6b9-e20b-4197-877d-16033b65c801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c733f6b9-e20b-4197-877d-16033b65c801 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:33.131290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:33.132309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:33.133155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 137/282] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:33.141194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9883572-ade2-48a7-9a1a-a3dc346a9790 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:33.300790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9883572-ade2-48a7-9a1a-a3dc346a9790 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:33.350368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d84023-6703-48cb-a1ab-4101d6c20874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:33.351371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d84023-6703-48cb-a1ab-4101d6c20874 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:33.351853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d84023-6703-48cb-a1ab-4101d6c20874 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:33.352321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d84023-6703-48cb-a1ab-4101d6c20874 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:33.353244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d84023-6703-48cb-a1ab-4101d6c20874 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:33.353748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d84023-6703-48cb-a1ab-4101d6c20874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:33.355379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d84023-6703-48cb-a1ab-4101d6c20874 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:33.369011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 146/283] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:33.375227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733f6b9-e20b-4197-877d-16033b65c801 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:33.535195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733f6b9-e20b-4197-877d-16033b65c801 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:33.576289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:33.585490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cada26-844e-48ea-a58d-3984ccca1409 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:33.585962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cada26-844e-48ea-a58d-3984ccca1409 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:33.586035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cada26-844e-48ea-a58d-3984ccca1409 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:33.587076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9609c2f-7d3a-4b13-bc1c-e38752443b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:33.587643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 147/284] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:56:33.588427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609c2f-7d3a-4b13-bc1c-e38752443b5d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:33.588921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609c2f-7d3a-4b13-bc1c-e38752443b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:33.589406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609c2f-7d3a-4b13-bc1c-e38752443b5d None admin] PATH_INFO: `/v3/users/6777a827ce2846dda86f04294159b5ff` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:33.590776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9609c2f-7d3a-4b13-bc1c-e38752443b5d None admin] RBAC: Authorizing `identity:get_user(user_id=6777a827ce2846dda86f04294159b5ff)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:33.592456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9609c2f-7d3a-4b13-bc1c-e38752443b5d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:33.594263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 138/285] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:33 2022] GET /identity/v3/users/6777a827ce2846dda86f04294159b5ff => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:33.599861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cada26-844e-48ea-a58d-3984ccca1409 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:33.604385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db14eb-a8d6-4ab3-8f77-2a99734c45a3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:33.604887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db14eb-a8d6-4ab3-8f77-2a99734c45a3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:33.605656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db14eb-a8d6-4ab3-8f77-2a99734c45a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:33.626397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b5db14eb-a8d6-4ab3-8f77-2a99734c45a3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:33.627957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b5db14eb-a8d6-4ab3-8f77-2a99734c45a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:33.631965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:33.735767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 139/286] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:33.792820 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cada26-844e-48ea-a58d-3984ccca1409 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:33.845805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac12c45-510a-49cf-8a0b-8d73d26b8084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:33.846799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac12c45-510a-49cf-8a0b-8d73d26b8084 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:33.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac12c45-510a-49cf-8a0b-8d73d26b8084 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:33.847768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac12c45-510a-49cf-8a0b-8d73d26b8084 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:33.849278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac12c45-510a-49cf-8a0b-8d73d26b8084 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:33.850996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac12c45-510a-49cf-8a0b-8d73d26b8084 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:33.852846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 148/287] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:33 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:33.858913 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db14eb-a8d6-4ab3-8f77-2a99734c45a3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:33.985239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db14eb-a8d6-4ab3-8f77-2a99734c45a3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:34.019577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:34.030485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902afbc-5d18-4876-aede-b6d8f5727766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:34.031447 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902afbc-5d18-4876-aede-b6d8f5727766 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:34.031931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902afbc-5d18-4876-aede-b6d8f5727766 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:34.032419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902afbc-5d18-4876-aede-b6d8f5727766 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/users/6777a827ce2846dda86f04294159b5ff/roles/971973e4c615467dbf11c183a74f5d3a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:34.035525 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902afbc-5d18-4876-aede-b6d8f5727766 None admin] RBAC: Authorizing `identity:create_grant(project_id=237f2ccd89da4522952fcbe9127d4d2c, user_id=6777a827ce2846dda86f04294159b5ff, role_id=971973e4c615467dbf11c183a74f5d3a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:34.037395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902afbc-5d18-4876-aede-b6d8f5727766 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:34.060120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 140/288] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:56:33 2022] PUT /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/users/6777a827ce2846dda86f04294159b5ff/roles/971973e4c615467dbf11c183a74f5d3a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:34.082775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac12c45-510a-49cf-8a0b-8d73d26b8084 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:34.196274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:34.226120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac12c45-510a-49cf-8a0b-8d73d26b8084 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:34.276968 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a41c3c-0872-403e-844e-a5007fd507e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:34.277653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a41c3c-0872-403e-844e-a5007fd507e0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:34.278202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a41c3c-0872-403e-844e-a5007fd507e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:34.278469 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a41c3c-0872-403e-844e-a5007fd507e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:34.289387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a41c3c-0872-403e-844e-a5007fd507e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a0a41c3c-0872-403e-844e-a5007fd507e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:34.294699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:34.295547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:34.296403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 149/289] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:34.301684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902afbc-5d18-4876-aede-b6d8f5727766 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:34.417856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902afbc-5d18-4876-aede-b6d8f5727766 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:34.461776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b74755-f5e1-4b1d-938c-2e7e28501016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:34.462835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b74755-f5e1-4b1d-938c-2e7e28501016 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:34.463316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b74755-f5e1-4b1d-938c-2e7e28501016 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:34.463830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b74755-f5e1-4b1d-938c-2e7e28501016 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:34.464702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b74755-f5e1-4b1d-938c-2e7e28501016 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:34.465225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b74755-f5e1-4b1d-938c-2e7e28501016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:34.466802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b74755-f5e1-4b1d-938c-2e7e28501016 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:34.478552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 141/290] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:34.484412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a41c3c-0872-403e-844e-a5007fd507e0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:34.623019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a41c3c-0872-403e-844e-a5007fd507e0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:34.669013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d424-86fb-484c-82f8-5b5e377f7754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:34.669602 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d424-86fb-484c-82f8-5b5e377f7754 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:34.669879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d424-86fb-484c-82f8-5b5e377f7754 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:34.670149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d424-86fb-484c-82f8-5b5e377f7754 None admin] PATH_INFO: `/v3/users/f4aec042415745678dfa08a941881c80` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:34.671272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74d424-86fb-484c-82f8-5b5e377f7754 None admin] RBAC: Authorizing `identity:get_user(user_id=f4aec042415745678dfa08a941881c80)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:34.672801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74d424-86fb-484c-82f8-5b5e377f7754 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:34.674585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 150/291] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:34 2022] GET /identity/v3/users/f4aec042415745678dfa08a941881c80 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:34.680261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b74755-f5e1-4b1d-938c-2e7e28501016 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:34.774152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:34.839705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b74755-f5e1-4b1d-938c-2e7e28501016 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:34.874029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129092e2-34a5-490c-8f31-c01b1ae9efb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:34.875312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129092e2-34a5-490c-8f31-c01b1ae9efb9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:34.875871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129092e2-34a5-490c-8f31-c01b1ae9efb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:34.876304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129092e2-34a5-490c-8f31-c01b1ae9efb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:34.959282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129092e2-34a5-490c-8f31-c01b1ae9efb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:34.960733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129092e2-34a5-490c-8f31-c01b1ae9efb9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:35.023241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:35.090236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 142/292] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:35.096035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d424-86fb-484c-82f8-5b5e377f7754 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:35.114175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53352fd5-06af-4053-a7c8-37df92c9b2e1 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.114865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53352fd5-06af-4053-a7c8-37df92c9b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.115211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53352fd5-06af-4053-a7c8-37df92c9b2e1 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:35.116575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 143/293] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:35.118372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:35.122896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab9a9-9efb-4f32-8c1e-3f36d9735696 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.123320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab9a9-9efb-4f32-8c1e-3f36d9735696 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.123422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab9a9-9efb-4f32-8c1e-3f36d9735696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:35.143607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c30ab9a9-9efb-4f32-8c1e-3f36d9735696 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:35.144808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c30ab9a9-9efb-4f32-8c1e-3f36d9735696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:35.245008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 144/294] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:35.312941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800d2c-3994-441a-b6a6-fa22924bb654 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.313246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800d2c-3994-441a-b6a6-fa22924bb654 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.313519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800d2c-3994-441a-b6a6-fa22924bb654 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:35.313620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d424-86fb-484c-82f8-5b5e377f7754 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:35.314918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 145/295] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:56:35.327953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b170ef-c932-4c79-8c65-a3dab9692364 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.328245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b170ef-c932-4c79-8c65-a3dab9692364 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.328798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b170ef-c932-4c79-8c65-a3dab9692364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:35.354858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e1b170ef-c932-4c79-8c65-a3dab9692364 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:35.356063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e1b170ef-c932-4c79-8c65-a3dab9692364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:35.357644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891f7ba-5d78-4ca5-be6d-5df8202fdd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:35.358613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891f7ba-5d78-4ca5-be6d-5df8202fdd57 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.359804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891f7ba-5d78-4ca5-be6d-5df8202fdd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.360224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891f7ba-5d78-4ca5-be6d-5df8202fdd57 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:35.361540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891f7ba-5d78-4ca5-be6d-5df8202fdd57 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:35.363159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891f7ba-5d78-4ca5-be6d-5df8202fdd57 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:35.366074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 151/296] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:35 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:35.373383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d34a-6f49-4457-903c-18959cb46b27 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.373383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d34a-6f49-4457-903c-18959cb46b27 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.373383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6d34a-6f49-4457-903c-18959cb46b27 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:35.373383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 152/297] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:35.373383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6d34a-6f49-4457-903c-18959cb46b27 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:35.443141 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 146/298] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:35.444791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca23dc3-6824-4256-b1c8-57429e45bd0c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.445299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca23dc3-6824-4256-b1c8-57429e45bd0c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.445838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca23dc3-6824-4256-b1c8-57429e45bd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:35.464126 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dca23dc3-6824-4256-b1c8-57429e45bd0c None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:35.465623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dca23dc3-6824-4256-b1c8-57429e45bd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:35.469274 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:35.492567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:35.536954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 147/299] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:35.553620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6d34a-6f49-4457-903c-18959cb46b27 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:35.554269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca23dc3-6824-4256-b1c8-57429e45bd0c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:35.618755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4769-f806-404d-bc96-0ab6b7ff469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:35.619367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4769-f806-404d-bc96-0ab6b7ff469e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.619642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4769-f806-404d-bc96-0ab6b7ff469e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.619908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4769-f806-404d-bc96-0ab6b7ff469e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:35.620645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4769-f806-404d-bc96-0ab6b7ff469e None admin] RBAC: Adding query filter params (role.id=b86a73fa9cc046eeae600bffd4218e7b, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c, user.id=f4aec042415745678dfa08a941881c80) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:35.620944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4769-f806-404d-bc96-0ab6b7ff469e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:35.622469 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4769-f806-404d-bc96-0ab6b7ff469e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:35.634468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 153/300] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:35 2022] GET /identity/v3/role_assignments?user.id=f4aec042415745678dfa08a941881c80&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:35.686295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca23dc3-6824-4256-b1c8-57429e45bd0c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:35.738614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab063c1-2c9d-47a2-bdaa-9f47a38c0c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:35.739272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab063c1-2c9d-47a2-bdaa-9f47a38c0c7d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.739549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab063c1-2c9d-47a2-bdaa-9f47a38c0c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.739816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab063c1-2c9d-47a2-bdaa-9f47a38c0c7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:35.754379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:35.758312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab063c1-2c9d-47a2-bdaa-9f47a38c0c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8ab063c1-2c9d-47a2-bdaa-9f47a38c0c7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:35.763413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:35.764312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:35.765107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 148/301] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:56:35.771064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4769-f806-404d-bc96-0ab6b7ff469e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:35.794524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab063c1-2c9d-47a2-bdaa-9f47a38c0c7d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:35.923525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4769-f806-404d-bc96-0ab6b7ff469e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:35.950156 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab063c1-2c9d-47a2-bdaa-9f47a38c0c7d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:35.968241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedb35b-7db0-4710-a156-ae5e3b1497d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:35.968863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb35b-7db0-4710-a156-ae5e3b1497d1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.969188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb35b-7db0-4710-a156-ae5e3b1497d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.969459 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedb35b-7db0-4710-a156-ae5e3b1497d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:35.970155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedb35b-7db0-4710-a156-ae5e3b1497d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:35.970665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedb35b-7db0-4710-a156-ae5e3b1497d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:35.971822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedb35b-7db0-4710-a156-ae5e3b1497d1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:35.982257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 154/302] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:35.983243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedb35b-7db0-4710-a156-ae5e3b1497d1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:35.987020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:35.998338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bf799-bb63-4973-832e-61cc1580f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:35.999074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bf799-bb63-4973-832e-61cc1580f365 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:35.999401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bf799-bb63-4973-832e-61cc1580f365 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:35.999677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bf799-bb63-4973-832e-61cc1580f365 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:36.000798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bf799-bb63-4973-832e-61cc1580f365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:36.002301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bf799-bb63-4973-832e-61cc1580f365 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:36.004005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 149/303] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:36.004590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bf799-bb63-4973-832e-61cc1580f365 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:36.076284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:36.090593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedb35b-7db0-4710-a156-ae5e3b1497d1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:36.111956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bf799-bb63-4973-832e-61cc1580f365 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:36.126102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516279-b95e-4fbc-8216-c88238ee97fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:36.126739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516279-b95e-4fbc-8216-c88238ee97fe None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:36.127020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516279-b95e-4fbc-8216-c88238ee97fe None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:36.127292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516279-b95e-4fbc-8216-c88238ee97fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:36.143140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79516279-b95e-4fbc-8216-c88238ee97fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:36.146996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdf621-d2ce-4517-8dad-7662bfe27b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:36.150250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdf621-d2ce-4517-8dad-7662bfe27b24 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:36.150250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdf621-d2ce-4517-8dad-7662bfe27b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:36.150250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdf621-d2ce-4517-8dad-7662bfe27b24 None admin] PATH_INFO: `/v3/users/f4c127f8b9754a72b7b3d24278c4afdd` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-79516279-b95e-4fbc-8216-c88238ee97fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:36.150470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:36.151354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:36.152131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 155/304] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:36.155756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516279-b95e-4fbc-8216-c88238ee97fe None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:36.169686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdf621-d2ce-4517-8dad-7662bfe27b24 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c127f8b9754a72b7b3d24278c4afdd)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:36.171346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdf621-d2ce-4517-8dad-7662bfe27b24 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:36.178179 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 150/305] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:36 2022] GET /identity/v3/users/f4c127f8b9754a72b7b3d24278c4afdd => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:36.178179 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdf621-d2ce-4517-8dad-7662bfe27b24 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:36.224228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:36.266868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516279-b95e-4fbc-8216-c88238ee97fe None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:36.280688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdf621-d2ce-4517-8dad-7662bfe27b24 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:36.307146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e37b97-ca0d-43eb-bef1-ae346bbec302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:36.307844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e37b97-ca0d-43eb-bef1-ae346bbec302 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:36.308123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e37b97-ca0d-43eb-bef1-ae346bbec302 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:36.308389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e37b97-ca0d-43eb-bef1-ae346bbec302 None admin] PATH_INFO: `/v3/groups` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:36.309001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:36.309121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e37b97-ca0d-43eb-bef1-ae346bbec302 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:36.310553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e37b97-ca0d-43eb-bef1-ae346bbec302 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:36.319044 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8a3f0-7363-4545-9b34-55a1de9027ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:36.319881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8a3f0-7363-4545-9b34-55a1de9027ac None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:36.320140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8a3f0-7363-4545-9b34-55a1de9027ac None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:36.320499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8a3f0-7363-4545-9b34-55a1de9027ac None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:36.321241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8a3f0-7363-4545-9b34-55a1de9027ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:36.321574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8a3f0-7363-4545-9b34-55a1de9027ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:36.322939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8a3f0-7363-4545-9b34-55a1de9027ac None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:36.337342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 156/306] 10.222.0.76 () {60 vars in 1134 bytes} [Mon Sep 19 16:56:36 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:56:36.337342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e37b97-ca0d-43eb-bef1-ae346bbec302 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:36.337639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 151/307] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:36.343554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8a3f0-7363-4545-9b34-55a1de9027ac None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:36.454994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8a3f0-7363-4545-9b34-55a1de9027ac None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:36.472204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e37b97-ca0d-43eb-bef1-ae346bbec302 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:36.490451 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7902d-8037-47db-a9fe-3a68b62ccbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:36.491341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7902d-8037-47db-a9fe-3a68b62ccbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:36.491713 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7902d-8037-47db-a9fe-3a68b62ccbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:36.492088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7902d-8037-47db-a9fe-3a68b62ccbd3 None admin] PATH_INFO: `/v3/users/5fa3073111314a76992af1e359df7c95` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:36.493432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7902d-8037-47db-a9fe-3a68b62ccbd3 None admin] RBAC: Authorizing `identity:get_user(user_id=5fa3073111314a76992af1e359df7c95)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:36.495201 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7902d-8037-47db-a9fe-3a68b62ccbd3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:36.496949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 152/308] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:36 2022] GET /identity/v3/users/5fa3073111314a76992af1e359df7c95 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:36.502150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:36.503787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7902d-8037-47db-a9fe-3a68b62ccbd3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:36.522086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f83a3-a9a0-4f97-ae99-f172ecf3e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:36.522829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f83a3-a9a0-4f97-ae99-f172ecf3e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:36.523109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f83a3-a9a0-4f97-ae99-f172ecf3e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:36.523384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f83a3-a9a0-4f97-ae99-f172ecf3e6f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:36.524736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f83a3-a9a0-4f97-ae99-f172ecf3e6f0 None admin] RBAC: Adding query filter params (role.id=971973e4c615467dbf11c183a74f5d3a, user.id=f4c127f8b9754a72b7b3d24278c4afdd, scope.system=all) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:36.525068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f83a3-a9a0-4f97-ae99-f172ecf3e6f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:36.527186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f83a3-a9a0-4f97-ae99-f172ecf3e6f0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:36.545077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 157/309] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Sep 19 16:56:36 2022] GET /identity/v3/role_assignments?user.id=f4c127f8b9754a72b7b3d24278c4afdd&scope.system=all&role.id=971973e4c615467dbf11c183a74f5d3a => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:36.586317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:36.632885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7902d-8037-47db-a9fe-3a68b62ccbd3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:36.674927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf6e7a-6f58-4bd3-8320-6a69c5987d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:36.675888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf6e7a-6f58-4bd3-8320-6a69c5987d5e None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:36.676332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf6e7a-6f58-4bd3-8320-6a69c5987d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:36.676755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf6e7a-6f58-4bd3-8320-6a69c5987d5e None admin] PATH_INFO: `/v3/system/users/5fa3073111314a76992af1e359df7c95/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:36.678602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf6e7a-6f58-4bd3-8320-6a69c5987d5e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5fa3073111314a76992af1e359df7c95, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:36.680350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf6e7a-6f58-4bd3-8320-6a69c5987d5e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:36.691939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 153/310] 10.222.0.76 () {58 vars in 1334 bytes} [Mon Sep 19 16:56:36 2022] PUT /identity/v3/system/users/5fa3073111314a76992af1e359df7c95/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:36.773648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ed82-ff5c-4de9-b6bc-1128f97443ce None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:36.774178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ed82-ff5c-4de9-b6bc-1128f97443ce None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:36.774178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343ed82-ff5c-4de9-b6bc-1128f97443ce None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:36.775913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 158/311] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:36.781908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657f780-9551-46f5-8ee6-d13893aaa0a9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:36.782539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657f780-9551-46f5-8ee6-d13893aaa0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:36.783014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657f780-9551-46f5-8ee6-d13893aaa0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:36.803974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c657f780-9551-46f5-8ee6-d13893aaa0a9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:36.805886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c657f780-9551-46f5-8ee6-d13893aaa0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:36.882260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 154/312] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:37.143843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343ed82-ff5c-4de9-b6bc-1128f97443ce None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:37.254333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343ed82-ff5c-4de9-b6bc-1128f97443ce None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:37.290311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1900aea-dcaa-47e2-bc4c-1eede4afed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:37.290964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1900aea-dcaa-47e2-bc4c-1eede4afed89 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:37.291242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1900aea-dcaa-47e2-bc4c-1eede4afed89 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:37.291509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1900aea-dcaa-47e2-bc4c-1eede4afed89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:37.302939 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1900aea-dcaa-47e2-bc4c-1eede4afed89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a1900aea-dcaa-47e2-bc4c-1eede4afed89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:37.307807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:37.308655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:37.309452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 159/313] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:37.316321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657f780-9551-46f5-8ee6-d13893aaa0a9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:37.367213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:37.420894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657f780-9551-46f5-8ee6-d13893aaa0a9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:37.456004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0898e1-2c44-40fa-99a5-1c82dc1fc833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:37.457053 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0898e1-2c44-40fa-99a5-1c82dc1fc833 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:37.457529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0898e1-2c44-40fa-99a5-1c82dc1fc833 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:37.457969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0898e1-2c44-40fa-99a5-1c82dc1fc833 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:37.458931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0898e1-2c44-40fa-99a5-1c82dc1fc833 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:37.459408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0898e1-2c44-40fa-99a5-1c82dc1fc833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:37.461004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0898e1-2c44-40fa-99a5-1c82dc1fc833 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:37.470853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 155/314] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:37.476813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1900aea-dcaa-47e2-bc4c-1eede4afed89 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:37.526350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:37.582692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1900aea-dcaa-47e2-bc4c-1eede4afed89 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:37.621079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258fd08-5956-4c82-8e41-feb03d60ea0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:37.622107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258fd08-5956-4c82-8e41-feb03d60ea0c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:37.622581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258fd08-5956-4c82-8e41-feb03d60ea0c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:37.623039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258fd08-5956-4c82-8e41-feb03d60ea0c None admin] PATH_INFO: `/v3/users/6777a827ce2846dda86f04294159b5ff` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:37.624372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258fd08-5956-4c82-8e41-feb03d60ea0c None admin] RBAC: Authorizing `identity:get_user(user_id=6777a827ce2846dda86f04294159b5ff)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:37.626068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258fd08-5956-4c82-8e41-feb03d60ea0c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:37.628261 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 160/315] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:37 2022] GET /identity/v3/users/6777a827ce2846dda86f04294159b5ff => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:37.633695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0898e1-2c44-40fa-99a5-1c82dc1fc833 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:37.731730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0898e1-2c44-40fa-99a5-1c82dc1fc833 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:37.744779 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:37.766360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7c38-1c81-4b80-8716-9ec857597e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:37.766975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7c38-1c81-4b80-8716-9ec857597e14 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:37.767249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7c38-1c81-4b80-8716-9ec857597e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:37.767517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac7c38-1c81-4b80-8716-9ec857597e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:37.836478 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac7c38-1c81-4b80-8716-9ec857597e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:37.838006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac7c38-1c81-4b80-8716-9ec857597e14 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:37.942001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 156/316] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:37.947740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258fd08-5956-4c82-8e41-feb03d60ea0c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:38.052321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258fd08-5956-4c82-8e41-feb03d60ea0c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:38.068408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:38.087383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800be013-87b2-4ab1-8fbd-14542b35aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:38.088013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800be013-87b2-4ab1-8fbd-14542b35aa9f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:38.088288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800be013-87b2-4ab1-8fbd-14542b35aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:38.088555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800be013-87b2-4ab1-8fbd-14542b35aa9f None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:38.089693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800be013-87b2-4ab1-8fbd-14542b35aa9f None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:38.091143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800be013-87b2-4ab1-8fbd-14542b35aa9f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:38.092764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 161/317] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:37 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:38.098795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7c38-1c81-4b80-8716-9ec857597e14 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:38.113811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:38.205541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac7c38-1c81-4b80-8716-9ec857597e14 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:38.239283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7d4c3-0c9e-4dfd-9c19-eae6165d5883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:38.239920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d4c3-0c9e-4dfd-9c19-eae6165d5883 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:38.240229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d4c3-0c9e-4dfd-9c19-eae6165d5883 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:38.240499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d4c3-0c9e-4dfd-9c19-eae6165d5883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:38.241252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7d4c3-0c9e-4dfd-9c19-eae6165d5883 None admin] RBAC: Adding query filter params (role.id=971973e4c615467dbf11c183a74f5d3a, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c, user.id=6777a827ce2846dda86f04294159b5ff) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:38.241559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7d4c3-0c9e-4dfd-9c19-eae6165d5883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:38.243002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7d4c3-0c9e-4dfd-9c19-eae6165d5883 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:38.249246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 157/318] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:56:38 2022] GET /identity/v3/role_assignments?user.id=6777a827ce2846dda86f04294159b5ff&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=971973e4c615467dbf11c183a74f5d3a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:38.690992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f792-d432-49ca-b45c-0fc5bf7bc54c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:38.691385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f792-d432-49ca-b45c-0fc5bf7bc54c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:38.691553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f792-d432-49ca-b45c-0fc5bf7bc54c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:38.692916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 162/319] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:38.698910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac972-87e4-4f47-8d7e-b32eecf38fb6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:38.699206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac972-87e4-4f47-8d7e-b32eecf38fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:38.699484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ac972-87e4-4f47-8d7e-b32eecf38fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:38.718726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-836ac972-87e4-4f47-8d7e-b32eecf38fb6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:38.719923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-836ac972-87e4-4f47-8d7e-b32eecf38fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:38.793071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bca76-897f-423f-a654-8a8b2c52a508 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:38.793071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bca76-897f-423f-a654-8a8b2c52a508 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:38.793071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bca76-897f-423f-a654-8a8b2c52a508 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:38.793523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 158/320] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:38.795001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 163/321] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:56:38.801136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59c2ca-f2e0-4d52-af59-b64af2424148 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:38.801696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59c2ca-f2e0-4d52-af59-b64af2424148 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:38.802148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59c2ca-f2e0-4d52-af59-b64af2424148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:38.816542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:38.823034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fd59c2ca-f2e0-4d52-af59-b64af2424148 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:38.824583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fd59c2ca-f2e0-4d52-af59-b64af2424148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:38.889488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 159/322] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:38.896991 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c1d51-f9ab-470a-b796-93dabda7c0e4 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:38.897334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c1d51-f9ab-470a-b796-93dabda7c0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:38.897605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c1d51-f9ab-470a-b796-93dabda7c0e4 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:38.899086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 164/323] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:38.904204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9bc64-7f10-44aa-8d58-d09d522e3ecb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:38.904500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9bc64-7f10-44aa-8d58-d09d522e3ecb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:38.904773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9bc64-7f10-44aa-8d58-d09d522e3ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:38.923234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ddf9bc64-7f10-44aa-8d58-d09d522e3ecb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:38.924417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ddf9bc64-7f10-44aa-8d58-d09d522e3ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:38.988800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 160/324] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:39.056899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c1d51-f9ab-470a-b796-93dabda7c0e4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:39.152907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9bc64-7f10-44aa-8d58-d09d522e3ecb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:39.169570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c1d51-f9ab-470a-b796-93dabda7c0e4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:39.211307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa1e67-5f63-4f8f-b551-ec7af87c7da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:39.211949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1e67-5f63-4f8f-b551-ec7af87c7da4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:39.212343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1e67-5f63-4f8f-b551-ec7af87c7da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:39.212617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1e67-5f63-4f8f-b551-ec7af87c7da4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:39.213891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa1e67-5f63-4f8f-b551-ec7af87c7da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:39.215403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa1e67-5f63-4f8f-b551-ec7af87c7da4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:39.217357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 165/325] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:39.222828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa1e67-5f63-4f8f-b551-ec7af87c7da4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:39.232198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:39.275545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9bc64-7f10-44aa-8d58-d09d522e3ecb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:39.284535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:39.309653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04621726-c30b-4c30-8325-d31f440ca3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:39.310319 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04621726-c30b-4c30-8325-d31f440ca3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:39.310602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04621726-c30b-4c30-8325-d31f440ca3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:39.310873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04621726-c30b-4c30-8325-d31f440ca3b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:39.320748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04621726-c30b-4c30-8325-d31f440ca3b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-04621726-c30b-4c30-8325-d31f440ca3b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:39.325562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:39.326431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:39.327225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 161/326] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:56:39.328060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04621726-c30b-4c30-8325-d31f440ca3b2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:39.335637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa1e67-5f63-4f8f-b551-ec7af87c7da4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:39.370670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ff3f-a520-45d9-92c7-79bf39f64fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:39.371359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ff3f-a520-45d9-92c7-79bf39f64fe8 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:39.371640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ff3f-a520-45d9-92c7-79bf39f64fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:39.371908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ff3f-a520-45d9-92c7-79bf39f64fe8 None admin] PATH_INFO: `/v3/groups` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:39.372538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ff3f-a520-45d9-92c7-79bf39f64fe8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:39.373998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54ff3f-a520-45d9-92c7-79bf39f64fe8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:39.389319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 166/327] 10.222.0.76 () {60 vars in 1134 bytes} [Mon Sep 19 16:56:39 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:56:39.393246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ff3f-a520-45d9-92c7-79bf39f64fe8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:39.437271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04621726-c30b-4c30-8325-d31f440ca3b2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:39.466640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:39.476589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485827c-1607-4fe9-8e67-c1b88badf6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:39.477269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485827c-1607-4fe9-8e67-c1b88badf6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:39.477549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485827c-1607-4fe9-8e67-c1b88badf6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:39.477816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485827c-1607-4fe9-8e67-c1b88badf6f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:39.490163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485827c-1607-4fe9-8e67-c1b88badf6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f485827c-1607-4fe9-8e67-c1b88badf6f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:39.495076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:39.495971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:39.496916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 162/328] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:39.502678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485827c-1607-4fe9-8e67-c1b88badf6f7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:39.507992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ff3f-a520-45d9-92c7-79bf39f64fe8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:39.523420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:39.549752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade259c-ac2e-4258-a64e-101d337370fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:39.550300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade259c-ac2e-4258-a64e-101d337370fb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:39.550578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade259c-ac2e-4258-a64e-101d337370fb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:39.550848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade259c-ac2e-4258-a64e-101d337370fb None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:39.551633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade259c-ac2e-4258-a64e-101d337370fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:39.551849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade259c-ac2e-4258-a64e-101d337370fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:39.553506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade259c-ac2e-4258-a64e-101d337370fb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:39.562664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 167/329] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:39.568352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade259c-ac2e-4258-a64e-101d337370fb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:39.628986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485827c-1607-4fe9-8e67-c1b88badf6f7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:39.666207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef8744-2a1b-4296-918d-6853437ae0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:39.667093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef8744-2a1b-4296-918d-6853437ae0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:39.667093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef8744-2a1b-4296-918d-6853437ae0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:39.667353 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef8744-2a1b-4296-918d-6853437ae0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:39.668021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef8744-2a1b-4296-918d-6853437ae0c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:39.668319 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef8744-2a1b-4296-918d-6853437ae0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:39.669796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef8744-2a1b-4296-918d-6853437ae0c6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:39.680030 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade259c-ac2e-4258-a64e-101d337370fb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:39.682421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 163/330] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:39.689596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef8744-2a1b-4296-918d-6853437ae0c6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:39.723372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40bfe5-af4d-4172-a759-e159ba3df7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:39.724705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40bfe5-af4d-4172-a759-e159ba3df7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:39.725366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40bfe5-af4d-4172-a759-e159ba3df7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:39.726423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40bfe5-af4d-4172-a759-e159ba3df7c9 None admin] PATH_INFO: `/v3/users/f4c127f8b9754a72b7b3d24278c4afdd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:39.728107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40bfe5-af4d-4172-a759-e159ba3df7c9 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c127f8b9754a72b7b3d24278c4afdd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:39.730499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40bfe5-af4d-4172-a759-e159ba3df7c9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:39.732134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 168/331] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:39 2022] GET /identity/v3/users/f4c127f8b9754a72b7b3d24278c4afdd => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:39.737955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40bfe5-af4d-4172-a759-e159ba3df7c9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:39.745707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:39.793018 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:39.815475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef8744-2a1b-4296-918d-6853437ae0c6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:39.862548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40bfe5-af4d-4172-a759-e159ba3df7c9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:39.865903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34512030-8223-4e98-934a-7d9b81ce4990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:39.867115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34512030-8223-4e98-934a-7d9b81ce4990 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:39.867115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34512030-8223-4e98-934a-7d9b81ce4990 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:39.867304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34512030-8223-4e98-934a-7d9b81ce4990 None admin] PATH_INFO: `/v3/users/5fa3073111314a76992af1e359df7c95` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:39.868340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34512030-8223-4e98-934a-7d9b81ce4990 None admin] RBAC: Authorizing `identity:get_user(user_id=5fa3073111314a76992af1e359df7c95)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:39.869833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34512030-8223-4e98-934a-7d9b81ce4990 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:39.871860 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 164/332] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:39 2022] GET /identity/v3/users/5fa3073111314a76992af1e359df7c95 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:39.877171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34512030-8223-4e98-934a-7d9b81ce4990 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:39.909019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e3af0-a4d5-4b62-9ea4-6353ae0bbe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:39.910303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e3af0-a4d5-4b62-9ea4-6353ae0bbe3b None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:39.910731 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e3af0-a4d5-4b62-9ea4-6353ae0bbe3b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:39.911583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e3af0-a4d5-4b62-9ea4-6353ae0bbe3b None admin] PATH_INFO: `/v3/system/users/f4c127f8b9754a72b7b3d24278c4afdd/roles/971973e4c615467dbf11c183a74f5d3a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:39.913644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e3af0-a4d5-4b62-9ea4-6353ae0bbe3b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f4c127f8b9754a72b7b3d24278c4afdd, role_id=971973e4c615467dbf11c183a74f5d3a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:39.916290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e3af0-a4d5-4b62-9ea4-6353ae0bbe3b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:39.931584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 169/333] 10.222.0.76 () {58 vars in 1334 bytes} [Mon Sep 19 16:56:39 2022] PUT /identity/v3/system/users/f4c127f8b9754a72b7b3d24278c4afdd/roles/971973e4c615467dbf11c183a74f5d3a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:56:40.001706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34512030-8223-4e98-934a-7d9b81ce4990 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:40.022596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:40.045285 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3764a07-03bd-4191-bb26-748c6bc79868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:40.046215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3764a07-03bd-4191-bb26-748c6bc79868 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:40.046646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3764a07-03bd-4191-bb26-748c6bc79868 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:40.047107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3764a07-03bd-4191-bb26-748c6bc79868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:40.048001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3764a07-03bd-4191-bb26-748c6bc79868 None admin] RBAC: Adding query filter params (role.id=b86a73fa9cc046eeae600bffd4218e7b, user.id=5fa3073111314a76992af1e359df7c95, scope.system=all) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:40.048456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3764a07-03bd-4191-bb26-748c6bc79868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:40.050155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3764a07-03bd-4191-bb26-748c6bc79868 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:40.064902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 165/334] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Sep 19 16:56:39 2022] GET /identity/v3/role_assignments?user.id=5fa3073111314a76992af1e359df7c95&scope.system=all&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:42.012457 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809650bc-87ac-4917-8093-c290540dea01 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:42.012977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809650bc-87ac-4917-8093-c290540dea01 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:42.012977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809650bc-87ac-4917-8093-c290540dea01 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:42.014821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 170/335] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:42.020008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123a0a-e574-4094-83da-26ef4d401135 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:42.020766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123a0a-e574-4094-83da-26ef4d401135 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:42.020941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123a0a-e574-4094-83da-26ef4d401135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:42.040465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1e123a0a-e574-4094-83da-26ef4d401135 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:42.045795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1e123a0a-e574-4094-83da-26ef4d401135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:42.125432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 166/336] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:42.172462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6cb69-1947-458a-997a-d97d46fd8c70 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:42.172823 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6cb69-1947-458a-997a-d97d46fd8c70 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:42.173023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6cb69-1947-458a-997a-d97d46fd8c70 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:42.174561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 171/337] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:42.180084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52328ff-49e3-42f5-9286-3f3533674cc1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:42.180378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52328ff-49e3-42f5-9286-3f3533674cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:42.180656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52328ff-49e3-42f5-9286-3f3533674cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:42.203759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c52328ff-49e3-42f5-9286-3f3533674cc1 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:42.204972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c52328ff-49e3-42f5-9286-3f3533674cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:42.288634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 167/338] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:42.495093 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6cb69-1947-458a-997a-d97d46fd8c70 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:42.628294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6cb69-1947-458a-997a-d97d46fd8c70 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:42.635815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:42.672631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52328ff-49e3-42f5-9286-3f3533674cc1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:42.673388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab03ef-9258-4dd1-8cfc-aa0391088a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:42.674038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab03ef-9258-4dd1-8cfc-aa0391088a10 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:42.674319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab03ef-9258-4dd1-8cfc-aa0391088a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:42.674886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab03ef-9258-4dd1-8cfc-aa0391088a10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:42.694759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab03ef-9258-4dd1-8cfc-aa0391088a10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-cbab03ef-9258-4dd1-8cfc-aa0391088a10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:42.703945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:42.704828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:42.705691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 172/339] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:42.713341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab03ef-9258-4dd1-8cfc-aa0391088a10 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:42.741111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:42.867367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab03ef-9258-4dd1-8cfc-aa0391088a10 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:42.903816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52328ff-49e3-42f5-9286-3f3533674cc1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:42.931771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49659bdb-ec23-4995-8ba9-a35a9aeb3e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:42.932390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49659bdb-ec23-4995-8ba9-a35a9aeb3e37 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:42.932671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49659bdb-ec23-4995-8ba9-a35a9aeb3e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:42.932940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49659bdb-ec23-4995-8ba9-a35a9aeb3e37 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:42.933646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49659bdb-ec23-4995-8ba9-a35a9aeb3e37 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:42.933964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49659bdb-ec23-4995-8ba9-a35a9aeb3e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:42.935356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49659bdb-ec23-4995-8ba9-a35a9aeb3e37 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:42.946051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 173/340] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:42.947288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f8c2a-609a-4f98-bf8d-f72bbd21e138 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:42.947572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f8c2a-609a-4f98-bf8d-f72bbd21e138 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:42.947847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f8c2a-609a-4f98-bf8d-f72bbd21e138 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:42.951121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 174/341] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:42.951855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f8c2a-609a-4f98-bf8d-f72bbd21e138 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:42.984250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baf32d1-6084-4192-be3d-54246343957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:42.984911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf32d1-6084-4192-be3d-54246343957f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:42.985221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf32d1-6084-4192-be3d-54246343957f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:42.985511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf32d1-6084-4192-be3d-54246343957f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:42.988725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:43.010628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baf32d1-6084-4192-be3d-54246343957f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8baf32d1-6084-4192-be3d-54246343957f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:43.019916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:43.021756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:43.022556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:43.023161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 168/342] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:43.024277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014d51-19c7-4622-b20e-b10b06b2c04a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:43.024567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014d51-19c7-4622-b20e-b10b06b2c04a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:43.024843 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014d51-19c7-4622-b20e-b10b06b2c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:43.065841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-13014d51-19c7-4622-b20e-b10b06b2c04a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:43.067050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-13014d51-19c7-4622-b20e-b10b06b2c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:43.160487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f8c2a-609a-4f98-bf8d-f72bbd21e138 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:43.209737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 169/343] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:43.210439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13014d51-19c7-4622-b20e-b10b06b2c04a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:43.222511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea734a-db66-4cf2-a2b4-11b8730fc863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:43.223740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea734a-db66-4cf2-a2b4-11b8730fc863 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:43.224012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea734a-db66-4cf2-a2b4-11b8730fc863 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:43.224439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea734a-db66-4cf2-a2b4-11b8730fc863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:43.264508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:43.364198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13014d51-19c7-4622-b20e-b10b06b2c04a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:43.375304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea734a-db66-4cf2-a2b4-11b8730fc863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:43.377429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea734a-db66-4cf2-a2b4-11b8730fc863 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:43.406218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753be38-ba5f-4f62-b1d0-baf273bfa8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:43.406843 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753be38-ba5f-4f62-b1d0-baf273bfa8af None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:43.407124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753be38-ba5f-4f62-b1d0-baf273bfa8af None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:43.407397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753be38-ba5f-4f62-b1d0-baf273bfa8af None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:43.408080 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753be38-ba5f-4f62-b1d0-baf273bfa8af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:43.408384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753be38-ba5f-4f62-b1d0-baf273bfa8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:43.410372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753be38-ba5f-4f62-b1d0-baf273bfa8af None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:43.420023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 170/344] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:43.421054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1616-ec9f-4f6b-ac3a-9c6fdbb19782 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:43.422036 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:43.422146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1616-ec9f-4f6b-ac3a-9c6fdbb19782 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:43.422962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b1616-ec9f-4f6b-ac3a-9c6fdbb19782 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:43.428104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 171/345] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:43.429607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1616-ec9f-4f6b-ac3a-9c6fdbb19782 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:43.533917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 175/346] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:43.535182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4b00-eebb-40c0-8a8e-b45ec4aca876 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:43.535460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4b00-eebb-40c0-8a8e-b45ec4aca876 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:43.535733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4b00-eebb-40c0-8a8e-b45ec4aca876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:43.568766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:43.582224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3dcd4b00-eebb-40c0-8a8e-b45ec4aca876 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:43.583445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3dcd4b00-eebb-40c0-8a8e-b45ec4aca876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:43.614029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b1616-ec9f-4f6b-ac3a-9c6fdbb19782 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:43.675648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ecad-7005-4525-9653-8fb17d4c3f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:43.676427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ecad-7005-4525-9653-8fb17d4c3f8b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:43.676753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ecad-7005-4525-9653-8fb17d4c3f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:43.677737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8ecad-7005-4525-9653-8fb17d4c3f8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:43.702182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 176/347] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:43.703049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd4b00-eebb-40c0-8a8e-b45ec4aca876 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:43.748868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8ecad-7005-4525-9653-8fb17d4c3f8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:43.750421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8ecad-7005-4525-9653-8fb17d4c3f8b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:43.770699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:43.827694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd4b00-eebb-40c0-8a8e-b45ec4aca876 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:43.838411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:43.855097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 172/348] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:43.855954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ecad-7005-4525-9653-8fb17d4c3f8b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:43.875944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced17f01-8425-4be8-a98d-65a9f3f203bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:43.876694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17f01-8425-4be8-a98d-65a9f3f203bf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:43.876979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17f01-8425-4be8-a98d-65a9f3f203bf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:43.877285 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17f01-8425-4be8-a98d-65a9f3f203bf None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:43.878502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced17f01-8425-4be8-a98d-65a9f3f203bf None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:43.881301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced17f01-8425-4be8-a98d-65a9f3f203bf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:43.883224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 177/349] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:43 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:43.884429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc14ed3-0ab8-47e4-a10f-79839bf39786 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:43.884769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc14ed3-0ab8-47e4-a10f-79839bf39786 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:43.885163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc14ed3-0ab8-47e4-a10f-79839bf39786 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:43.886487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 178/350] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:43.887237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc14ed3-0ab8-47e4-a10f-79839bf39786 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:43.969872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8ecad-7005-4525-9653-8fb17d4c3f8b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.004546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b07737-617d-41a1-90aa-38df824b050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.004753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc14ed3-0ab8-47e4-a10f-79839bf39786 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.005214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b07737-617d-41a1-90aa-38df824b050f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.005545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b07737-617d-41a1-90aa-38df824b050f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.005845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b07737-617d-41a1-90aa-38df824b050f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.016998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b07737-617d-41a1-90aa-38df824b050f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-92b07737-617d-41a1-90aa-38df824b050f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:44.022488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:44.023784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:44.024581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 173/351] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:44.025260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b07737-617d-41a1-90aa-38df824b050f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:44.035088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:44.046425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c23d5-56f8-463e-ae7e-93d64a9dbdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.047073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c23d5-56f8-463e-ae7e-93d64a9dbdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.047400 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c23d5-56f8-463e-ae7e-93d64a9dbdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.047676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c23d5-56f8-463e-ae7e-93d64a9dbdf6 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.048809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c23d5-56f8-463e-ae7e-93d64a9dbdf6 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:44.050311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c23d5-56f8-463e-ae7e-93d64a9dbdf6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:44.051959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 179/352] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:43 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:44.053366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a397b-27f8-41a4-ab30-a71a992c7270 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.053645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a397b-27f8-41a4-ab30-a71a992c7270 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.053913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a397b-27f8-41a4-ab30-a71a992c7270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.073415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3d7a397b-27f8-41a4-ab30-a71a992c7270 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:44.074932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3d7a397b-27f8-41a4-ab30-a71a992c7270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:44.088379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:44.154549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b07737-617d-41a1-90aa-38df824b050f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.162138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 180/353] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:44.163494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a397b-27f8-41a4-ab30-a71a992c7270 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:44.194347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b5fc-9fe5-45a3-8e85-ca4eaa433080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.195129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b5fc-9fe5-45a3-8e85-ca4eaa433080 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.195460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b5fc-9fe5-45a3-8e85-ca4eaa433080 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.195733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985b5fc-9fe5-45a3-8e85-ca4eaa433080 None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.202396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985b5fc-9fe5-45a3-8e85-ca4eaa433080 None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:44.204076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985b5fc-9fe5-45a3-8e85-ca4eaa433080 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:44.206105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 174/354] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:44 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:44.207329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b5fc-9fe5-45a3-8e85-ca4eaa433080 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:44.282133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a397b-27f8-41a4-ab30-a71a992c7270 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.312359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:44.326758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb0354-4c1f-4f8e-9b56-dc8eb424b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.327770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb0354-4c1f-4f8e-9b56-dc8eb424b276 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.328156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb0354-4c1f-4f8e-9b56-dc8eb424b276 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.328486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb0354-4c1f-4f8e-9b56-dc8eb424b276 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.329565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb0354-4c1f-4f8e-9b56-dc8eb424b276 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:44.329866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb0354-4c1f-4f8e-9b56-dc8eb424b276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:44.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb0354-4c1f-4f8e-9b56-dc8eb424b276 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:44.343020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985b5fc-9fe5-45a3-8e85-ca4eaa433080 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.343894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 181/355] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:44.344910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb0354-4c1f-4f8e-9b56-dc8eb424b276 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:44.356201 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:44.385521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3cc6f-8dc1-4266-afd5-7b4afe9a614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.386165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cc6f-8dc1-4266-afd5-7b4afe9a614b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.386442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cc6f-8dc1-4266-afd5-7b4afe9a614b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.386712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3cc6f-8dc1-4266-afd5-7b4afe9a614b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.399424 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3cc6f-8dc1-4266-afd5-7b4afe9a614b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-eff3cc6f-8dc1-4266-afd5-7b4afe9a614b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:44.405060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:44.405949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:44.406719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 175/356] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:44.407355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3cc6f-8dc1-4266-afd5-7b4afe9a614b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:44.477633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb0354-4c1f-4f8e-9b56-dc8eb424b276 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.520843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee204acc-f982-4039-b4d1-ac5746951a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.521550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee204acc-f982-4039-b4d1-ac5746951a32 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.522474 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee204acc-f982-4039-b4d1-ac5746951a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.522474 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee204acc-f982-4039-b4d1-ac5746951a32 None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.523222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee204acc-f982-4039-b4d1-ac5746951a32 None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:44.524666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee204acc-f982-4039-b4d1-ac5746951a32 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:44.526502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 182/357] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:44 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:44.527164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee204acc-f982-4039-b4d1-ac5746951a32 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:44.528920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3cc6f-8dc1-4266-afd5-7b4afe9a614b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.564651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a44f6a-d063-4b55-9986-9663e35c4dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.565228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a44f6a-d063-4b55-9986-9663e35c4dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.565501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a44f6a-d063-4b55-9986-9663e35c4dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.566109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a44f6a-d063-4b55-9986-9663e35c4dd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.566505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a44f6a-d063-4b55-9986-9663e35c4dd4 None admin] RBAC: Adding query filter params (group.id=0cabd5c1ce7f41c58c0813884623163a, role.id=b86a73fa9cc046eeae600bffd4218e7b, scope.project.id=cd13a123c9a040d092492aaa25e0225e) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:44.566807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a44f6a-d063-4b55-9986-9663e35c4dd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:44.568399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a44f6a-d063-4b55-9986-9663e35c4dd4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:44.575007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 176/358] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Sep 19 16:56:44 2022] GET /identity/v3/role_assignments?group.id=0cabd5c1ce7f41c58c0813884623163a&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:44.575967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a44f6a-d063-4b55-9986-9663e35c4dd4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:44.595224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:44.634137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:44.669917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee204acc-f982-4039-b4d1-ac5746951a32 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.722408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f34a8-1906-439f-8215-1f0ad391be86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.723026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a44f6a-d063-4b55-9986-9663e35c4dd4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.723479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f34a8-1906-439f-8215-1f0ad391be86 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.723964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f34a8-1906-439f-8215-1f0ad391be86 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.724308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f34a8-1906-439f-8215-1f0ad391be86 None admin] PATH_INFO: `/v3/users/f4c127f8b9754a72b7b3d24278c4afdd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.725810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f34a8-1906-439f-8215-1f0ad391be86 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c127f8b9754a72b7b3d24278c4afdd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:44.728312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f34a8-1906-439f-8215-1f0ad391be86 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:44.730463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 183/359] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:56:44 2022] GET /identity/v3/users/f4c127f8b9754a72b7b3d24278c4afdd => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:44.731788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a3cb7-4b12-47aa-86bd-83545a30a5e3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.732073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a3cb7-4b12-47aa-86bd-83545a30a5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.732346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a3cb7-4b12-47aa-86bd-83545a30a5e3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.734465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 184/360] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:44.735232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a3cb7-4b12-47aa-86bd-83545a30a5e3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:44.776683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29564d-94aa-4f62-9604-0a036e794867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.778084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29564d-94aa-4f62-9604-0a036e794867 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.778084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29564d-94aa-4f62-9604-0a036e794867 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.778245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29564d-94aa-4f62-9604-0a036e794867 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.779118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29564d-94aa-4f62-9604-0a036e794867 None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:44.779415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29564d-94aa-4f62-9604-0a036e794867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:44.781471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29564d-94aa-4f62-9604-0a036e794867 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:44.792787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 177/361] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:44.793884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29564d-94aa-4f62-9604-0a036e794867 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:44.873276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a3cb7-4b12-47aa-86bd-83545a30a5e3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.898954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:44.909534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a1f76-2734-4923-90fd-1cdb52a692f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.910355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a1f76-2734-4923-90fd-1cdb52a692f6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.910753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a1f76-2734-4923-90fd-1cdb52a692f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.911165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a1f76-2734-4923-90fd-1cdb52a692f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.918866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:44.930417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29564d-94aa-4f62-9604-0a036e794867 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:44.931600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a1f76-2734-4923-90fd-1cdb52a692f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4d1a1f76-2734-4923-90fd-1cdb52a692f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:44.936974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:44.937889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:44.938712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:44.939350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 185/362] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:44.940649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a1f76-2734-4923-90fd-1cdb52a692f6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:44.982597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53328ee-1a74-4310-b628-0d4e588905f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:44.983730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53328ee-1a74-4310-b628-0d4e588905f1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.984242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53328ee-1a74-4310-b628-0d4e588905f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.984545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53328ee-1a74-4310-b628-0d4e588905f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:44.986319 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53328ee-1a74-4310-b628-0d4e588905f1 None admin] RBAC: Adding query filter params (group.id=0cabd5c1ce7f41c58c0813884623163a, role.id=ee6045909540420b8b406a308fdad516, scope.project.id=cd13a123c9a040d092492aaa25e0225e) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:44.986319 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53328ee-1a74-4310-b628-0d4e588905f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:44.987254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53328ee-1a74-4310-b628-0d4e588905f1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:44.994891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 178/363] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Sep 19 16:56:44 2022] GET /identity/v3/role_assignments?group.id=0cabd5c1ce7f41c58c0813884623163a&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=ee6045909540420b8b406a308fdad516 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:44.996249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb1a2-d59f-4fca-99e9-0eff1c62cf06 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:44.996572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb1a2-d59f-4fca-99e9-0eff1c62cf06 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:44.996882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb1a2-d59f-4fca-99e9-0eff1c62cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:45.018754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d9bfb1a2-d59f-4fca-99e9-0eff1c62cf06 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:45.020007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d9bfb1a2-d59f-4fca-99e9-0eff1c62cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:45.079370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a1f76-2734-4923-90fd-1cdb52a692f6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:45.099352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 179/364] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:45.105791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb1a2-d59f-4fca-99e9-0eff1c62cf06 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:45.136092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085be7c-6ac4-435f-9185-92b0ba9071bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:45.137116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085be7c-6ac4-435f-9185-92b0ba9071bf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:45.137603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085be7c-6ac4-435f-9185-92b0ba9071bf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:45.138454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085be7c-6ac4-435f-9185-92b0ba9071bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:45.145591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085be7c-6ac4-435f-9185-92b0ba9071bf None admin] RBAC: Adding query filter params (role.id=971973e4c615467dbf11c183a74f5d3a, user.id=f4c127f8b9754a72b7b3d24278c4afdd, scope.system=all) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:45.145591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085be7c-6ac4-435f-9185-92b0ba9071bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:45.145591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085be7c-6ac4-435f-9185-92b0ba9071bf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:45.172141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 186/365] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Sep 19 16:56:44 2022] GET /identity/v3/role_assignments?user.id=f4c127f8b9754a72b7b3d24278c4afdd&scope.system=all&role.id=971973e4c615467dbf11c183a74f5d3a => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:45.172141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085be7c-6ac4-435f-9185-92b0ba9071bf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:45.230862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:45.307049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:45.313804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085be7c-6ac4-435f-9185-92b0ba9071bf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:45.325735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb1a2-d59f-4fca-99e9-0eff1c62cf06 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:45.370490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab67f1-2e45-4663-989f-77f1bf235721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:45.371129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab67f1-2e45-4663-989f-77f1bf235721 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:45.371403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab67f1-2e45-4663-989f-77f1bf235721 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:45.371669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab67f1-2e45-4663-989f-77f1bf235721 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:45.372364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab67f1-2e45-4663-989f-77f1bf235721 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:45.372658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab67f1-2e45-4663-989f-77f1bf235721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:45.374123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab67f1-2e45-4663-989f-77f1bf235721 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:45.388473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 187/366] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:45.395023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab67f1-2e45-4663-989f-77f1bf235721 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:45.400266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f222c6-ce2b-43e5-b130-f875240162f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:45.401022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f222c6-ce2b-43e5-b130-f875240162f4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:45.401260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f222c6-ce2b-43e5-b130-f875240162f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:45.401505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f222c6-ce2b-43e5-b130-f875240162f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:45.513563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f222c6-ce2b-43e5-b130-f875240162f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:45.515103 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f222c6-ce2b-43e5-b130-f875240162f4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:45.522056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab67f1-2e45-4663-989f-77f1bf235721 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:45.524481 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:45.563337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663b1cd-e047-4149-98e6-dd08c0e96e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:45.564370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663b1cd-e047-4149-98e6-dd08c0e96e66 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:45.564820 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663b1cd-e047-4149-98e6-dd08c0e96e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:45.565403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663b1cd-e047-4149-98e6-dd08c0e96e66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:45.649573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663b1cd-e047-4149-98e6-dd08c0e96e66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:45.649743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:45.651401 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663b1cd-e047-4149-98e6-dd08c0e96e66 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:45.663296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 180/367] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:45.664237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f222c6-ce2b-43e5-b130-f875240162f4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:45.761843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 188/368] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:56:45.762785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663b1cd-e047-4149-98e6-dd08c0e96e66 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:45.765244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:45.793226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f222c6-ce2b-43e5-b130-f875240162f4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:45.840604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc3ea9-25e4-487d-abed-de40d89c550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:45.841333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3ea9-25e4-487d-abed-de40d89c550f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:45.841610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3ea9-25e4-487d-abed-de40d89c550f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:45.841877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc3ea9-25e4-487d-abed-de40d89c550f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:45.863361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc3ea9-25e4-487d-abed-de40d89c550f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b3dc3ea9-25e4-487d-abed-de40d89c550f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:45.870051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:45.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:45.871664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:45.873158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 181/369] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:45.874079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc3ea9-25e4-487d-abed-de40d89c550f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:45.901154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663b1cd-e047-4149-98e6-dd08c0e96e66 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:45.940253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcc72f-2cf5-4561-b833-0a0ed245bbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:45.941062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcc72f-2cf5-4561-b833-0a0ed245bbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:45.941446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcc72f-2cf5-4561-b833-0a0ed245bbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:45.941806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcc72f-2cf5-4561-b833-0a0ed245bbf6 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:45.941929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:45.943649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcc72f-2cf5-4561-b833-0a0ed245bbf6 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:45.945747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcc72f-2cf5-4561-b833-0a0ed245bbf6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:45.947723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 189/370] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:45 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:45.948592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcc72f-2cf5-4561-b833-0a0ed245bbf6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:46.000960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc3ea9-25e4-487d-abed-de40d89c550f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:46.041465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:46.044902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ea20d-aadd-4d5a-bc2f-8f8eea19688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:46.045837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ea20d-aadd-4d5a-bc2f-8f8eea19688e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:46.046351 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ea20d-aadd-4d5a-bc2f-8f8eea19688e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:46.046793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ea20d-aadd-4d5a-bc2f-8f8eea19688e None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:46.048227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ea20d-aadd-4d5a-bc2f-8f8eea19688e None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:46.049877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ea20d-aadd-4d5a-bc2f-8f8eea19688e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:46.052042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 182/371] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:45 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:46.053111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ea20d-aadd-4d5a-bc2f-8f8eea19688e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:46.077264 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcc72f-2cf5-4561-b833-0a0ed245bbf6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:46.122001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257febf-76ea-46ca-b620-c4d3571d17c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:46.123239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257febf-76ea-46ca-b620-c4d3571d17c0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:46.123239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257febf-76ea-46ca-b620-c4d3571d17c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:46.123239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257febf-76ea-46ca-b620-c4d3571d17c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:46.124173 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257febf-76ea-46ca-b620-c4d3571d17c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:46.124491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257febf-76ea-46ca-b620-c4d3571d17c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:46.126287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257febf-76ea-46ca-b620-c4d3571d17c0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:46.140344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 190/372] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:46.142762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257febf-76ea-46ca-b620-c4d3571d17c0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:46.201672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ea20d-aadd-4d5a-bc2f-8f8eea19688e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:46.227533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:46.251867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8dc8c-3d54-4cb6-b17f-fbe9ad04cf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:46.253261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8dc8c-3d54-4cb6-b17f-fbe9ad04cf0d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:46.253659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8dc8c-3d54-4cb6-b17f-fbe9ad04cf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:46.254027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8dc8c-3d54-4cb6-b17f-fbe9ad04cf0d None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:46.255723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8dc8c-3d54-4cb6-b17f-fbe9ad04cf0d None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:46.258024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8dc8c-3d54-4cb6-b17f-fbe9ad04cf0d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:46.260976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 183/373] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:46 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:46.263042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8dc8c-3d54-4cb6-b17f-fbe9ad04cf0d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:46.271919 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257febf-76ea-46ca-b620-c4d3571d17c0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:46.311299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:46.316851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f34bf-6d5a-4abb-95e2-3c2d5023b1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:46.317686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f34bf-6d5a-4abb-95e2-3c2d5023b1bf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:46.318134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f34bf-6d5a-4abb-95e2-3c2d5023b1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:46.318914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f34bf-6d5a-4abb-95e2-3c2d5023b1bf None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:46.320710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f34bf-6d5a-4abb-95e2-3c2d5023b1bf None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:46.322330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f34bf-6d5a-4abb-95e2-3c2d5023b1bf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:46.324246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 191/374] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:46 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:46.329082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f34bf-6d5a-4abb-95e2-3c2d5023b1bf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:46.399902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8dc8c-3d54-4cb6-b17f-fbe9ad04cf0d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:46.451065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f34bf-6d5a-4abb-95e2-3c2d5023b1bf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:46.452098 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637b39b-81d1-4516-b878-43c2ba225422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:46.454106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637b39b-81d1-4516-b878-43c2ba225422 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:46.454106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637b39b-81d1-4516-b878-43c2ba225422 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:46.454106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637b39b-81d1-4516-b878-43c2ba225422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:46.495518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e263a-f2e0-45f7-9c42-bd765021cde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:46.496521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e263a-f2e0-45f7-9c42-bd765021cde6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:46.497017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e263a-f2e0-45f7-9c42-bd765021cde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:46.497534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e263a-f2e0-45f7-9c42-bd765021cde6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:46.498539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e263a-f2e0-45f7-9c42-bd765021cde6 None admin] RBAC: Adding query filter params (group.id=0cabd5c1ce7f41c58c0813884623163a, role.id=b86a73fa9cc046eeae600bffd4218e7b, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:46.499343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e263a-f2e0-45f7-9c42-bd765021cde6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:46.500981 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e263a-f2e0-45f7-9c42-bd765021cde6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:46.511494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 192/375] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Sep 19 16:56:46 2022] GET /identity/v3/role_assignments?group.id=0cabd5c1ce7f41c58c0813884623163a&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:46.512675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e263a-f2e0-45f7-9c42-bd765021cde6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:46.521146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:46.541104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637b39b-81d1-4516-b878-43c2ba225422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:46.542541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637b39b-81d1-4516-b878-43c2ba225422 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:46.596456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:46.648706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e263a-f2e0-45f7-9c42-bd765021cde6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:46.691260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb9f07-bd89-4445-a3e7-c0806b272f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:46.691890 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb9f07-bd89-4445-a3e7-c0806b272f68 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:46.692344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb9f07-bd89-4445-a3e7-c0806b272f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:46.692612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb9f07-bd89-4445-a3e7-c0806b272f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:46.693468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb9f07-bd89-4445-a3e7-c0806b272f68 None admin] RBAC: Adding query filter params (group.id=0cabd5c1ce7f41c58c0813884623163a, role.id=ee6045909540420b8b406a308fdad516, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:46.693779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb9f07-bd89-4445-a3e7-c0806b272f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:46.695881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb9f07-bd89-4445-a3e7-c0806b272f68 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:46.703603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 193/376] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Sep 19 16:56:46 2022] GET /identity/v3/role_assignments?group.id=0cabd5c1ce7f41c58c0813884623163a&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=ee6045909540420b8b406a308fdad516 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:46.717177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 184/377] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:46.722877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb9f07-bd89-4445-a3e7-c0806b272f68 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:46.857759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb9f07-bd89-4445-a3e7-c0806b272f68 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:46.886078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:46.895584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9a5c5-68c0-4d59-bba6-bb4e8ac9d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:46.896447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9a5c5-68c0-4d59-bba6-bb4e8ac9d3ca None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:46.896754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9a5c5-68c0-4d59-bba6-bb4e8ac9d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:46.897055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9a5c5-68c0-4d59-bba6-bb4e8ac9d3ca None admin] PATH_INFO: `/v3/projects/1401206b2abd4d4db9b2a1ade1bdd499` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:46.898406 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9a5c5-68c0-4d59-bba6-bb4e8ac9d3ca None admin] RBAC: Authorizing `identity:get_project(project_id=1401206b2abd4d4db9b2a1ade1bdd499)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:46.899904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9a5c5-68c0-4d59-bba6-bb4e8ac9d3ca None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:46.902032 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 194/378] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:46 2022] GET /identity/v3/projects/1401206b2abd4d4db9b2a1ade1bdd499 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:46.907330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637b39b-81d1-4516-b878-43c2ba225422 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:47.017440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:47.030390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637b39b-81d1-4516-b878-43c2ba225422 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:47.076057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78ce5a-a118-449b-8d7c-2e10a232938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:47.076704 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78ce5a-a118-449b-8d7c-2e10a232938d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:47.076984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78ce5a-a118-449b-8d7c-2e10a232938d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:47.077272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78ce5a-a118-449b-8d7c-2e10a232938d None admin] PATH_INFO: `/v3/groups/4c88c203bae548429558904e7a4de6a1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:47.083168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78ce5a-a118-449b-8d7c-2e10a232938d None admin] RBAC: Authorizing `identity:get_group(group_id=4c88c203bae548429558904e7a4de6a1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:47.084693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78ce5a-a118-449b-8d7c-2e10a232938d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:47.086700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 185/379] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:46 2022] GET /identity/v3/groups/4c88c203bae548429558904e7a4de6a1 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:47.092215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9a5c5-68c0-4d59-bba6-bb4e8ac9d3ca None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:47.235834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9a5c5-68c0-4d59-bba6-bb4e8ac9d3ca None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:47.240608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e2f97-4e2a-408a-872c-487041f4e090 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:47.241137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e2f97-4e2a-408a-872c-487041f4e090 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:47.241222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e2f97-4e2a-408a-872c-487041f4e090 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:47.242656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 186/380] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:56:47.247961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b3af-def6-491c-8b95-90c38cc2d872 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:47.248511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b3af-def6-491c-8b95-90c38cc2d872 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:47.248980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b3af-def6-491c-8b95-90c38cc2d872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:47.270850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d8f6b3af-def6-491c-8b95-90c38cc2d872 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:47.272455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d8f6b3af-def6-491c-8b95-90c38cc2d872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:47.290881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c4b8c-ee1b-4e66-859e-7e098bc3194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:47.291558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c4b8c-ee1b-4e66-859e-7e098bc3194a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:47.291776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c4b8c-ee1b-4e66-859e-7e098bc3194a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:47.292046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c4b8c-ee1b-4e66-859e-7e098bc3194a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:47.292786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c4b8c-ee1b-4e66-859e-7e098bc3194a None admin] RBAC: Adding query filter params (group.id=4c88c203bae548429558904e7a4de6a1, role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=1401206b2abd4d4db9b2a1ade1bdd499) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:47.293114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c4b8c-ee1b-4e66-859e-7e098bc3194a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:47.294588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c4b8c-ee1b-4e66-859e-7e098bc3194a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:47.306066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 195/381] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Sep 19 16:56:47 2022] GET /identity/v3/role_assignments?group.id=4c88c203bae548429558904e7a4de6a1&scope.project.id=1401206b2abd4d4db9b2a1ade1bdd499&role.id=77285ef607e34662b6234656fe8043d0 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:47.355496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 187/382] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:47.631121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c4b8c-ee1b-4e66-859e-7e098bc3194a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:47.694287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:47.738665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c4b8c-ee1b-4e66-859e-7e098bc3194a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:47.775842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bfaae-baf3-40a9-a3cf-fbd3c6d9d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:47.776889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bfaae-baf3-40a9-a3cf-fbd3c6d9d887 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:47.777457 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bfaae-baf3-40a9-a3cf-fbd3c6d9d887 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:47.777925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bfaae-baf3-40a9-a3cf-fbd3c6d9d887 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:47.791153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bfaae-baf3-40a9-a3cf-fbd3c6d9d887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-519bfaae-baf3-40a9-a3cf-fbd3c6d9d887 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:47.797172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:47.798159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:47.799007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:47.801640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 196/383] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:47.807967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b3af-def6-491c-8b95-90c38cc2d872 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:47.917340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:47.941648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b3af-def6-491c-8b95-90c38cc2d872 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:47.948203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141ac43-4d05-4136-b6f1-8c71939ce9a3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:47.948203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141ac43-4d05-4136-b6f1-8c71939ce9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:47.948203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141ac43-4d05-4136-b6f1-8c71939ce9a3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:47.948846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 197/384] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:47.955680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3485b5-ec13-4990-9245-61fb3212d302 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:47.956336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3485b5-ec13-4990-9245-61fb3212d302 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:47.956813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3485b5-ec13-4990-9245-61fb3212d302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:47.980432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ff3485b5-ec13-4990-9245-61fb3212d302 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:47.982580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ff3485b5-ec13-4990-9245-61fb3212d302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:48.017800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14c43b-dba9-4939-8454-1fef7f12a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:48.018437 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14c43b-dba9-4939-8454-1fef7f12a02a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:48.018718 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14c43b-dba9-4939-8454-1fef7f12a02a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:48.018985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14c43b-dba9-4939-8454-1fef7f12a02a None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:48.019662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14c43b-dba9-4939-8454-1fef7f12a02a None admin] RBAC: Adding query filter params (name=member) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:48.019960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14c43b-dba9-4939-8454-1fef7f12a02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:48.021814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14c43b-dba9-4939-8454-1fef7f12a02a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:48.037000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 188/385] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:48.044107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14c43b-dba9-4939-8454-1fef7f12a02a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:48.085995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 198/386] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:48.172430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14c43b-dba9-4939-8454-1fef7f12a02a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:48.207427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9557-fe77-4315-a67d-4574fc502b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:48.208073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9557-fe77-4315-a67d-4574fc502b8c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:48.208356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9557-fe77-4315-a67d-4574fc502b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:48.208701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a9557-fe77-4315-a67d-4574fc502b8c None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:48.209868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9557-fe77-4315-a67d-4574fc502b8c None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:48.211327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a9557-fe77-4315-a67d-4574fc502b8c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:48.212897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 189/387] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:48 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:48.218922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3485b5-ec13-4990-9245-61fb3212d302 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:48.275612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:48.332813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3485b5-ec13-4990-9245-61fb3212d302 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:48.374010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e776d-b408-4856-8d69-34b81db076bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:48.374720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e776d-b408-4856-8d69-34b81db076bb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:48.374997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e776d-b408-4856-8d69-34b81db076bb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:48.375320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e776d-b408-4856-8d69-34b81db076bb None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:48.376667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e776d-b408-4856-8d69-34b81db076bb None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:48.378152 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e776d-b408-4856-8d69-34b81db076bb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:48.380185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 199/388] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:48 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:48.386092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9557-fe77-4315-a67d-4574fc502b8c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:48.400385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:48.506335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a9557-fe77-4315-a67d-4574fc502b8c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:48.545634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a9e27-e0ae-4e7a-a350-1d9d422a7771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:48.546310 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a9e27-e0ae-4e7a-a350-1d9d422a7771 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:48.546591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a9e27-e0ae-4e7a-a350-1d9d422a7771 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:48.546862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a9e27-e0ae-4e7a-a350-1d9d422a7771 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e/groups/0cabd5c1ce7f41c58c0813884623163a/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:48.548793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a9e27-e0ae-4e7a-a350-1d9d422a7771 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd13a123c9a040d092492aaa25e0225e, group_id=0cabd5c1ce7f41c58c0813884623163a, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:48.550302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a9e27-e0ae-4e7a-a350-1d9d422a7771 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:48.565617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 190/389] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Sep 19 16:56:48 2022] PUT /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e/groups/0cabd5c1ce7f41c58c0813884623163a/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:48.704299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e776d-b408-4856-8d69-34b81db076bb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:48.833772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e776d-b408-4856-8d69-34b81db076bb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:48.855154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:48.882259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b517288-da7b-4b3a-a292-5c4c1c11ec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:48.882919 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b517288-da7b-4b3a-a292-5c4c1c11ec5f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:48.883196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b517288-da7b-4b3a-a292-5c4c1c11ec5f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:48.883512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b517288-da7b-4b3a-a292-5c4c1c11ec5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:48.897735 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b517288-da7b-4b3a-a292-5c4c1c11ec5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3b517288-da7b-4b3a-a292-5c4c1c11ec5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:48.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:48.905637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:48.906529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 200/390] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:48.911981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a9e27-e0ae-4e7a-a350-1d9d422a7771 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:49.026084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:49.059103 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a9e27-e0ae-4e7a-a350-1d9d422a7771 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:49.103581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e16ccb-1e86-4218-abe5-ebc2d764bf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:49.104137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e16ccb-1e86-4218-abe5-ebc2d764bf9c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:49.104419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e16ccb-1e86-4218-abe5-ebc2d764bf9c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:49.104692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e16ccb-1e86-4218-abe5-ebc2d764bf9c None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:49.105390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e16ccb-1e86-4218-abe5-ebc2d764bf9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:49.105694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e16ccb-1e86-4218-abe5-ebc2d764bf9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:49.107076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e16ccb-1e86-4218-abe5-ebc2d764bf9c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:49.120536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 191/391] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:49.126276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b517288-da7b-4b3a-a292-5c4c1c11ec5f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:49.291027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b517288-da7b-4b3a-a292-5c4c1c11ec5f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:49.338848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054146ef-ca4e-418f-9510-2d4e54044e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:49.339471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054146ef-ca4e-418f-9510-2d4e54044e23 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:49.339747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054146ef-ca4e-418f-9510-2d4e54044e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:49.340012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054146ef-ca4e-418f-9510-2d4e54044e23 None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:49.345708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054146ef-ca4e-418f-9510-2d4e54044e23 None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:49.347171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054146ef-ca4e-418f-9510-2d4e54044e23 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:49.349157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 201/392] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:49 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:49.355003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e16ccb-1e86-4218-abe5-ebc2d764bf9c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:49.493996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e16ccb-1e86-4218-abe5-ebc2d764bf9c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:49.527322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e4f59-a479-49e2-9b03-11bb37e66082 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:49.527680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e4f59-a479-49e2-9b03-11bb37e66082 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:49.527850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e4f59-a479-49e2-9b03-11bb37e66082 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:49.529613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 202/393] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:56:49.535338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf58b8-1b20-4ca2-b330-661868d207ba None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:49.535676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf58b8-1b20-4ca2-b330-661868d207ba None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:49.535868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf58b8-1b20-4ca2-b330-661868d207ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:49.537314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:49.545886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee77f-a193-437b-ba34-38695f1231f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:49.546567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee77f-a193-437b-ba34-38695f1231f7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:49.546883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee77f-a193-437b-ba34-38695f1231f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:49.547166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee77f-a193-437b-ba34-38695f1231f7 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:49.549517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee77f-a193-437b-ba34-38695f1231f7 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:49.551019 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee77f-a193-437b-ba34-38695f1231f7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:49.556914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 192/394] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:49 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:49.560626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee77f-a193-437b-ba34-38695f1231f7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:49.566575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-15bf58b8-1b20-4ca2-b330-661868d207ba None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:49.568158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-15bf58b8-1b20-4ca2-b330-661868d207ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:49.634967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:49.675871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 203/395] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:49.683979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18beee8a-8c91-4b19-b115-bd89f8d34912 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:49.683979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18beee8a-8c91-4b19-b115-bd89f8d34912 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:49.683979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18beee8a-8c91-4b19-b115-bd89f8d34912 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:49.683979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 204/396] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:49.684500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa54ad6-54e4-49a9-ac82-dc126cb56fb9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:49.684781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa54ad6-54e4-49a9-ac82-dc126cb56fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:49.685073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa54ad6-54e4-49a9-ac82-dc126cb56fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:49.719487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee77f-a193-437b-ba34-38695f1231f7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:49.722695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-caa54ad6-54e4-49a9-ac82-dc126cb56fb9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:49.723501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-caa54ad6-54e4-49a9-ac82-dc126cb56fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:49.760958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236c257-2789-427a-bf06-45dff179ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:49.764346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236c257-2789-427a-bf06-45dff179ee40 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:49.764832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236c257-2789-427a-bf06-45dff179ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:49.765349 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236c257-2789-427a-bf06-45dff179ee40 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e/groups/0cabd5c1ce7f41c58c0813884623163a/roles/ee6045909540420b8b406a308fdad516` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:49.771086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236c257-2789-427a-bf06-45dff179ee40 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd13a123c9a040d092492aaa25e0225e, group_id=0cabd5c1ce7f41c58c0813884623163a, role_id=ee6045909540420b8b406a308fdad516)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:49.773193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236c257-2789-427a-bf06-45dff179ee40 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:49.798673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 193/397] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Sep 19 16:56:49 2022] PUT /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e/groups/0cabd5c1ce7f41c58c0813884623163a/roles/ee6045909540420b8b406a308fdad516 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:56:49.834421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 205/398] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:50.064712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236c257-2789-427a-bf06-45dff179ee40 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:50.126709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:50.150524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08d503-cd40-4faf-99c4-3fde7a82d141 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:50.150848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08d503-cd40-4faf-99c4-3fde7a82d141 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:50.151081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08d503-cd40-4faf-99c4-3fde7a82d141 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:50.152681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 206/399] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:50.159088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cf882-6acf-445a-865e-3400f6e898eb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:50.159429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cf882-6acf-445a-865e-3400f6e898eb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:50.159708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cf882-6acf-445a-865e-3400f6e898eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:50.171275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236c257-2789-427a-bf06-45dff179ee40 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:50.201131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-994cf882-6acf-445a-865e-3400f6e898eb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:50.202512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-994cf882-6acf-445a-865e-3400f6e898eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:50.211952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e4360-01b2-455d-8624-6ef1fe16a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:50.212602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e4360-01b2-455d-8624-6ef1fe16a51f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:50.212888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e4360-01b2-455d-8624-6ef1fe16a51f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:50.213210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e4360-01b2-455d-8624-6ef1fe16a51f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:50.224291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e4360-01b2-455d-8624-6ef1fe16a51f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-732e4360-01b2-455d-8624-6ef1fe16a51f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:50.229690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:50.230573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:50.231336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:50.235774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 194/400] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:50.236593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e4360-01b2-455d-8624-6ef1fe16a51f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:50.285802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 207/401] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:50.287151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cf882-6acf-445a-865e-3400f6e898eb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:50.324391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:50.338965 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e4360-01b2-455d-8624-6ef1fe16a51f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:50.360418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:50.375357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062bd0-3b12-409f-b93e-da4606618c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:50.375995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062bd0-3b12-409f-b93e-da4606618c54 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:50.376281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062bd0-3b12-409f-b93e-da4606618c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:50.376557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062bd0-3b12-409f-b93e-da4606618c54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:50.387284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0062bd0-3b12-409f-b93e-da4606618c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b0062bd0-3b12-409f-b93e-da4606618c54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:50.392575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:50.393584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:50.394370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:50.399006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 195/402] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:50.400224 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062bd0-3b12-409f-b93e-da4606618c54 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:50.411218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cf882-6acf-445a-865e-3400f6e898eb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:50.449006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1ca19-e5ee-4cb8-a8aa-a650b0c835e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:50.450105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1ca19-e5ee-4cb8-a8aa-a650b0c835e9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:50.450641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1ca19-e5ee-4cb8-a8aa-a650b0c835e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:50.451106 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1ca19-e5ee-4cb8-a8aa-a650b0c835e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:50.451990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1ca19-e5ee-4cb8-a8aa-a650b0c835e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:50.452475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1ca19-e5ee-4cb8-a8aa-a650b0c835e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:50.454201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1ca19-e5ee-4cb8-a8aa-a650b0c835e9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:50.465487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 208/403] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:50.471988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1ca19-e5ee-4cb8-a8aa-a650b0c835e9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:50.513989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062bd0-3b12-409f-b93e-da4606618c54 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:50.557824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db30e8-321b-4652-a3c7-1b3f72c230d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:50.558592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db30e8-321b-4652-a3c7-1b3f72c230d9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:50.559012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db30e8-321b-4652-a3c7-1b3f72c230d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:50.559356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db30e8-321b-4652-a3c7-1b3f72c230d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:50.560138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db30e8-321b-4652-a3c7-1b3f72c230d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:50.561001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db30e8-321b-4652-a3c7-1b3f72c230d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:50.562019 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db30e8-321b-4652-a3c7-1b3f72c230d9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:50.575470 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 196/404] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:50.576690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db30e8-321b-4652-a3c7-1b3f72c230d9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:50.589754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:50.594653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1ca19-e5ee-4cb8-a8aa-a650b0c835e9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:50.620736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:50.632248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61726e0-08df-417a-92f0-08bd3c387794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:50.633118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61726e0-08df-417a-92f0-08bd3c387794 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:50.633573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61726e0-08df-417a-92f0-08bd3c387794 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:50.634069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61726e0-08df-417a-92f0-08bd3c387794 None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:50.635560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61726e0-08df-417a-92f0-08bd3c387794 None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:50.637834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61726e0-08df-417a-92f0-08bd3c387794 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:50.640022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 209/405] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:50 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:50.658374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61726e0-08df-417a-92f0-08bd3c387794 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:50.686130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db30e8-321b-4652-a3c7-1b3f72c230d9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:50.720641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b9abb-05b5-472d-964a-05bd21456f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:50.721341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b9abb-05b5-472d-964a-05bd21456f76 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:50.721623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b9abb-05b5-472d-964a-05bd21456f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:50.721894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b9abb-05b5-472d-964a-05bd21456f76 None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:50.723020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b9abb-05b5-472d-964a-05bd21456f76 None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:50.724527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b9abb-05b5-472d-964a-05bd21456f76 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:50.730933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 197/406] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:50 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:50.731804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b9abb-05b5-472d-964a-05bd21456f76 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:50.798640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61726e0-08df-417a-92f0-08bd3c387794 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:50.834026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c00b8-3403-4d06-8b0a-cf0885d91683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:50.834574 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c00b8-3403-4d06-8b0a-cf0885d91683 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:50.834852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c00b8-3403-4d06-8b0a-cf0885d91683 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:50.835122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c00b8-3403-4d06-8b0a-cf0885d91683 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:50.836500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c00b8-3403-4d06-8b0a-cf0885d91683 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:50.837920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c00b8-3403-4d06-8b0a-cf0885d91683 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:50.844585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 210/407] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:50 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:50.845429 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b9abb-05b5-472d-964a-05bd21456f76 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:50.845538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c00b8-3403-4d06-8b0a-cf0885d91683 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:50.858449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:50.884967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:50.886822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b51a-f4a4-4211-adc0-d461f878f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:50.888554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b51a-f4a4-4211-adc0-d461f878f81d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:50.888958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b51a-f4a4-4211-adc0-d461f878f81d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:50.889358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918b51a-f4a4-4211-adc0-d461f878f81d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:50.903699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918b51a-f4a4-4211-adc0-d461f878f81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c918b51a-f4a4-4211-adc0-d461f878f81d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:50.909613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:50.910499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:50.911456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 198/408] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:56:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:50.912434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b51a-f4a4-4211-adc0-d461f878f81d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:50.983242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c00b8-3403-4d06-8b0a-cf0885d91683 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:51.026953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918b51a-f4a4-4211-adc0-d461f878f81d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:51.028698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fc153-a3c0-44a0-a520-33e1f713c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:51.030461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc153-a3c0-44a0-a520-33e1f713c731 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:51.030815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc153-a3c0-44a0-a520-33e1f713c731 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:51.031230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fc153-a3c0-44a0-a520-33e1f713c731 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:51.032442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fc153-a3c0-44a0-a520-33e1f713c731 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:51.034031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fc153-a3c0-44a0-a520-33e1f713c731 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:51.036306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 211/409] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:50 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:51.037923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fc153-a3c0-44a0-a520-33e1f713c731 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:51.065785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde7f62-9bbd-49a0-bda0-b79dbed24c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:51.066569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde7f62-9bbd-49a0-bda0-b79dbed24c7e None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:51.066851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde7f62-9bbd-49a0-bda0-b79dbed24c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:51.067128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde7f62-9bbd-49a0-bda0-b79dbed24c7e None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/groups/0cabd5c1ce7f41c58c0813884623163a/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:51.069293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde7f62-9bbd-49a0-bda0-b79dbed24c7e None admin] RBAC: Authorizing `identity:create_grant(project_id=237f2ccd89da4522952fcbe9127d4d2c, group_id=0cabd5c1ce7f41c58c0813884623163a, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:51.070849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde7f62-9bbd-49a0-bda0-b79dbed24c7e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:51.086690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 199/410] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Sep 19 16:56:50 2022] PUT /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/groups/0cabd5c1ce7f41c58c0813884623163a/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:51.087438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde7f62-9bbd-49a0-bda0-b79dbed24c7e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:51.133111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:51.209235 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fc153-a3c0-44a0-a520-33e1f713c731 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:51.211122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:51.228933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde7f62-9bbd-49a0-bda0-b79dbed24c7e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:51.271108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe27f52-99f0-4671-9416-22d61d7c618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:51.272182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe27f52-99f0-4671-9416-22d61d7c618c None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:51.272703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe27f52-99f0-4671-9416-22d61d7c618c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:51.273219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe27f52-99f0-4671-9416-22d61d7c618c None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/groups/0cabd5c1ce7f41c58c0813884623163a/roles/ee6045909540420b8b406a308fdad516` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:51.276646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe27f52-99f0-4671-9416-22d61d7c618c None admin] RBAC: Authorizing `identity:create_grant(project_id=237f2ccd89da4522952fcbe9127d4d2c, group_id=0cabd5c1ce7f41c58c0813884623163a, role_id=ee6045909540420b8b406a308fdad516)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:51.278415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe27f52-99f0-4671-9416-22d61d7c618c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:51.301722 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 200/411] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Sep 19 16:56:51 2022] PUT /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c/groups/0cabd5c1ce7f41c58c0813884623163a/roles/ee6045909540420b8b406a308fdad516 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:51.303885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e434-3d7a-4863-9773-317b81da28e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:51.304960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e434-3d7a-4863-9773-317b81da28e6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:51.305577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e434-3d7a-4863-9773-317b81da28e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:51.306077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e434-3d7a-4863-9773-317b81da28e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:51.307249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2e434-3d7a-4863-9773-317b81da28e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:51.307776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2e434-3d7a-4863-9773-317b81da28e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:51.309720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2e434-3d7a-4863-9773-317b81da28e6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:51.320748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 212/412] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:51.327126 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe27f52-99f0-4671-9416-22d61d7c618c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:51.435885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:51.448566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe27f52-99f0-4671-9416-22d61d7c618c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:51.485638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbadf5-1744-44d0-92e1-761d107a4765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:51.486406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbadf5-1744-44d0-92e1-761d107a4765 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:51.486760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbadf5-1744-44d0-92e1-761d107a4765 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:51.487085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbadf5-1744-44d0-92e1-761d107a4765 None admin] PATH_INFO: `/v3/groups/4c88c203bae548429558904e7a4de6a1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:51.488359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbadf5-1744-44d0-92e1-761d107a4765 None admin] RBAC: Authorizing `identity:get_group(group_id=4c88c203bae548429558904e7a4de6a1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:51.489944 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbadf5-1744-44d0-92e1-761d107a4765 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:51.491954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 201/413] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:51 2022] GET /identity/v3/groups/4c88c203bae548429558904e7a4de6a1 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:51.497434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e434-3d7a-4863-9773-317b81da28e6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:51.611655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e434-3d7a-4863-9773-317b81da28e6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:51.649462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40427efa-4e7f-4ca1-b4ed-c403d80ec171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:51.650482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427efa-4e7f-4ca1-b4ed-c403d80ec171 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:51.650763 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427efa-4e7f-4ca1-b4ed-c403d80ec171 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:51.651036 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427efa-4e7f-4ca1-b4ed-c403d80ec171 None admin] PATH_INFO: `/v3/projects/1401206b2abd4d4db9b2a1ade1bdd499` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:51.652194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40427efa-4e7f-4ca1-b4ed-c403d80ec171 None admin] RBAC: Authorizing `identity:get_project(project_id=1401206b2abd4d4db9b2a1ade1bdd499)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:51.653673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40427efa-4e7f-4ca1-b4ed-c403d80ec171 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:51.655372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 213/414] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:51 2022] GET /identity/v3/projects/1401206b2abd4d4db9b2a1ade1bdd499 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:51.661112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbadf5-1744-44d0-92e1-761d107a4765 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:51.723477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1dc17-0b1c-4eac-a68a-e0fba22ea8ed None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:51.723658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1dc17-0b1c-4eac-a68a-e0fba22ea8ed None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:51.723938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1dc17-0b1c-4eac-a68a-e0fba22ea8ed None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:51.726034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 214/415] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:51.730911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ab3e8-2232-4977-b142-20145843a829 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:51.731423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ab3e8-2232-4977-b142-20145843a829 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:51.731837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ab3e8-2232-4977-b142-20145843a829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:51.762181 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3c8ab3e8-2232-4977-b142-20145843a829 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:51.763838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3c8ab3e8-2232-4977-b142-20145843a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:51.779484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbadf5-1744-44d0-92e1-761d107a4765 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:51.815317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:51.820947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674b148-1151-4c95-bfb5-127cad8cff04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:51.821657 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674b148-1151-4c95-bfb5-127cad8cff04 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:51.821934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674b148-1151-4c95-bfb5-127cad8cff04 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:51.822205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674b148-1151-4c95-bfb5-127cad8cff04 None admin] PATH_INFO: `/v3/projects/1401206b2abd4d4db9b2a1ade1bdd499/groups/4c88c203bae548429558904e7a4de6a1/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:51.824345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674b148-1151-4c95-bfb5-127cad8cff04 None admin] RBAC: Authorizing `identity:create_grant(project_id=1401206b2abd4d4db9b2a1ade1bdd499, group_id=4c88c203bae548429558904e7a4de6a1, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:51.825824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674b148-1151-4c95-bfb5-127cad8cff04 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:51.849055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 202/416] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Sep 19 16:56:51 2022] PUT /identity/v3/projects/1401206b2abd4d4db9b2a1ade1bdd499/groups/4c88c203bae548429558904e7a4de6a1/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:56:51.887311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 215/417] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:52.245657 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62e153-9cdd-426f-9359-02402eba4b60 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:52.246042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62e153-9cdd-426f-9359-02402eba4b60 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:52.246212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62e153-9cdd-426f-9359-02402eba4b60 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:52.247874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 203/418] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:52.252856 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e43a6-547b-4a48-b874-03ed89f6c920 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:52.253171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e43a6-547b-4a48-b874-03ed89f6c920 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:52.253443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e43a6-547b-4a48-b874-03ed89f6c920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:52.275153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d93e43a6-547b-4a48-b874-03ed89f6c920 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:52.276338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d93e43a6-547b-4a48-b874-03ed89f6c920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:52.297314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62e153-9cdd-426f-9359-02402eba4b60 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:52.318694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:52.359434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 216/419] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:56:52.453068 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62e153-9cdd-426f-9359-02402eba4b60 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:52.492750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e197e3-7e3c-4991-9ca1-0f48f82add56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:52.493409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e197e3-7e3c-4991-9ca1-0f48f82add56 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:52.493689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e197e3-7e3c-4991-9ca1-0f48f82add56 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:52.493959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e197e3-7e3c-4991-9ca1-0f48f82add56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:52.508098 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e197e3-7e3c-4991-9ca1-0f48f82add56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b5e197e3-7e3c-4991-9ca1-0f48f82add56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:52.512887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:52.513787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:52.514598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 204/420] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:56:52.520508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e43a6-547b-4a48-b874-03ed89f6c920 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:52.656647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:52.665958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e43a6-547b-4a48-b874-03ed89f6c920 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:52.716771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a4b78-23ed-4112-bb1d-97fe040b3c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:52.716967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e197e3-7e3c-4991-9ca1-0f48f82add56 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:52.717418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a4b78-23ed-4112-bb1d-97fe040b3c5e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:52.717656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a4b78-23ed-4112-bb1d-97fe040b3c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:52.717868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a4b78-23ed-4112-bb1d-97fe040b3c5e None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:52.718537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a4b78-23ed-4112-bb1d-97fe040b3c5e None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:52.718832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a4b78-23ed-4112-bb1d-97fe040b3c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:52.720195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a4b78-23ed-4112-bb1d-97fe040b3c5e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:52.738337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 217/421] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:52.742194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a4b78-23ed-4112-bb1d-97fe040b3c5e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:52.823671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:52.849941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e197e3-7e3c-4991-9ca1-0f48f82add56 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:52.890952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f8e0a-a966-46c0-95b1-ea21916459c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:52.891591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f8e0a-a966-46c0-95b1-ea21916459c8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:52.891866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f8e0a-a966-46c0-95b1-ea21916459c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:52.892132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f8e0a-a966-46c0-95b1-ea21916459c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:52.904035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f8e0a-a966-46c0-95b1-ea21916459c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b35f8e0a-a966-46c0-95b1-ea21916459c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:52.909569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:52.910427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:52.911239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 205/422] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:52.916692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f8e0a-a966-46c0-95b1-ea21916459c8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:52.963212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a4b78-23ed-4112-bb1d-97fe040b3c5e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:53.027582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3264-2c9a-4bd7-9052-9f7c2a7b17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:53.028199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3264-2c9a-4bd7-9052-9f7c2a7b17d7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:53.028472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3264-2c9a-4bd7-9052-9f7c2a7b17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:53.028737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed3264-2c9a-4bd7-9052-9f7c2a7b17d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:53.063512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f8e0a-a966-46c0-95b1-ea21916459c8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:53.078729 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:53.136393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00f8f9-8a77-44b5-bc8e-c911aa728992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:53.137257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00f8f9-8a77-44b5-bc8e-c911aa728992 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:53.137369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00f8f9-8a77-44b5-bc8e-c911aa728992 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:53.145453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00f8f9-8a77-44b5-bc8e-c911aa728992 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:53.145453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00f8f9-8a77-44b5-bc8e-c911aa728992 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:53.145453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00f8f9-8a77-44b5-bc8e-c911aa728992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:53.145453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00f8f9-8a77-44b5-bc8e-c911aa728992 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:53.155237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:53.166210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 206/423] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:53.167229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed3264-2c9a-4bd7-9052-9f7c2a7b17d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:53.168711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed3264-2c9a-4bd7-9052-9f7c2a7b17d7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:53.178846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00f8f9-8a77-44b5-bc8e-c911aa728992 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:53.318957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 218/424] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:53.324758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3264-2c9a-4bd7-9052-9f7c2a7b17d7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:53.332324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00f8f9-8a77-44b5-bc8e-c911aa728992 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:53.365656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55dd15-af55-43eb-839e-48ab9355471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:53.366645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55dd15-af55-43eb-839e-48ab9355471e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:53.367111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55dd15-af55-43eb-839e-48ab9355471e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:53.367631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55dd15-af55-43eb-839e-48ab9355471e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:53.397392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:53.480627 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed3264-2c9a-4bd7-9052-9f7c2a7b17d7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:53.481301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:53.482992 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55dd15-af55-43eb-839e-48ab9355471e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:53.484614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55dd15-af55-43eb-839e-48ab9355471e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:53.541935 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc30a5-873f-4b7c-99c7-8039dd6a9864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:53.542612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc30a5-873f-4b7c-99c7-8039dd6a9864 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:53.542851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc30a5-873f-4b7c-99c7-8039dd6a9864 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:53.543113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc30a5-873f-4b7c-99c7-8039dd6a9864 None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:53.548455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc30a5-873f-4b7c-99c7-8039dd6a9864 None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:53.550031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc30a5-873f-4b7c-99c7-8039dd6a9864 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:53.553697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 219/425] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:53 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:53.562146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc30a5-873f-4b7c-99c7-8039dd6a9864 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:53.621709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 207/426] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:53.622927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ebcf-7e62-4e10-8414-a858d6043675 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:53.623253 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ebcf-7e62-4e10-8414-a858d6043675 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:53.623529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363ebcf-7e62-4e10-8414-a858d6043675 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:53.628974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 208/427] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:53.628974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363ebcf-7e62-4e10-8414-a858d6043675 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:53.680720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc30a5-873f-4b7c-99c7-8039dd6a9864 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:53.705677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:53.720696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e109dd-8e75-4fe1-9aa8-1705ecbaaf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:53.721718 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e109dd-8e75-4fe1-9aa8-1705ecbaaf0f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:53.722194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e109dd-8e75-4fe1-9aa8-1705ecbaaf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:53.723464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e109dd-8e75-4fe1-9aa8-1705ecbaaf0f None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:53.724883 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e109dd-8e75-4fe1-9aa8-1705ecbaaf0f None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:53.726560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e109dd-8e75-4fe1-9aa8-1705ecbaaf0f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:53.728679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 220/428] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:53 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:53.730147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b87308-7cc3-49fc-8980-83d160a666bc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:53.730624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b87308-7cc3-49fc-8980-83d160a666bc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:53.731087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b87308-7cc3-49fc-8980-83d160a666bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:53.741136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:53.746373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363ebcf-7e62-4e10-8414-a858d6043675 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:53.751089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-88b87308-7cc3-49fc-8980-83d160a666bc None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:53.752506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-88b87308-7cc3-49fc-8980-83d160a666bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:53.787412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0aff9-ac11-476e-94b3-7d7c7fbfefcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:53.788055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0aff9-ac11-476e-94b3-7d7c7fbfefcc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:53.788333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0aff9-ac11-476e-94b3-7d7c7fbfefcc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:53.788610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0aff9-ac11-476e-94b3-7d7c7fbfefcc None admin] PATH_INFO: `/v3/projects/cd13a123c9a040d092492aaa25e0225e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:53.789873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0aff9-ac11-476e-94b3-7d7c7fbfefcc None admin] RBAC: Authorizing `identity:get_project(project_id=cd13a123c9a040d092492aaa25e0225e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:53.791381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0aff9-ac11-476e-94b3-7d7c7fbfefcc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:53.793381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 209/429] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:53 2022] GET /identity/v3/projects/cd13a123c9a040d092492aaa25e0225e => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:53.794157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0aff9-ac11-476e-94b3-7d7c7fbfefcc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:53.837071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 221/430] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:53.837071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b87308-7cc3-49fc-8980-83d160a666bc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:53.979429 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0aff9-ac11-476e-94b3-7d7c7fbfefcc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:54.021761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b87308-7cc3-49fc-8980-83d160a666bc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:54.049682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18b0a8-71fa-400d-a975-25908c5a0465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:54.050297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b0a8-71fa-400d-a975-25908c5a0465 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.050570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b0a8-71fa-400d-a975-25908c5a0465 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.050835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18b0a8-71fa-400d-a975-25908c5a0465 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.051571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18b0a8-71fa-400d-a975-25908c5a0465 None admin] RBAC: Adding query filter params (group.id=0cabd5c1ce7f41c58c0813884623163a, role.id=b86a73fa9cc046eeae600bffd4218e7b, scope.project.id=cd13a123c9a040d092492aaa25e0225e) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:54.051873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18b0a8-71fa-400d-a975-25908c5a0465 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:54.053960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18b0a8-71fa-400d-a975-25908c5a0465 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:54.065069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 210/431] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Sep 19 16:56:53 2022] GET /identity/v3/role_assignments?group.id=0cabd5c1ce7f41c58c0813884623163a&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 611 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:54.065069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6825-dbf3-43e8-8852-ed74e42907e5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.065069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6825-dbf3-43e8-8852-ed74e42907e5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.065069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6825-dbf3-43e8-8852-ed74e42907e5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.065069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 211/432] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:54.065481 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:54.074677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd645-72ab-42fc-8a0d-7e06689f92da None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.075045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd645-72ab-42fc-8a0d-7e06689f92da None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.075291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dd645-72ab-42fc-8a0d-7e06689f92da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.100397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1be29-5c2f-445e-8b29-892bfd8c24a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:54.101113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1be29-5c2f-445e-8b29-892bfd8c24a8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.101391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1be29-5c2f-445e-8b29-892bfd8c24a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.101657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1be29-5c2f-445e-8b29-892bfd8c24a8 None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.102835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1be29-5c2f-445e-8b29-892bfd8c24a8 None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:54.104320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1be29-5c2f-445e-8b29-892bfd8c24a8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:54.113067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 222/433] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:53 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:54.114076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-361dd645-72ab-42fc-8a0d-7e06689f92da None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:54.115364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-361dd645-72ab-42fc-8a0d-7e06689f92da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:54.120104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1be29-5c2f-445e-8b29-892bfd8c24a8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:54.169420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:54.221993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 212/434] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:54.223164 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dd645-72ab-42fc-8a0d-7e06689f92da None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:54.267897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1be29-5c2f-445e-8b29-892bfd8c24a8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:54.307437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3542c47-939b-4133-9b9a-69d2e31e041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:54.308118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3542c47-939b-4133-9b9a-69d2e31e041e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.308489 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3542c47-939b-4133-9b9a-69d2e31e041e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.308851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3542c47-939b-4133-9b9a-69d2e31e041e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.309930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3542c47-939b-4133-9b9a-69d2e31e041e None admin] RBAC: Adding query filter params (group.id=0cabd5c1ce7f41c58c0813884623163a, role.id=ee6045909540420b8b406a308fdad516, scope.project.id=cd13a123c9a040d092492aaa25e0225e) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:54.310685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3542c47-939b-4133-9b9a-69d2e31e041e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:54.312635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3542c47-939b-4133-9b9a-69d2e31e041e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:54.320624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 223/435] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Sep 19 16:56:54 2022] GET /identity/v3/role_assignments?group.id=0cabd5c1ce7f41c58c0813884623163a&scope.project.id=cd13a123c9a040d092492aaa25e0225e&role.id=ee6045909540420b8b406a308fdad516 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:54.373149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dd645-72ab-42fc-8a0d-7e06689f92da None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:54.417016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0de98-b683-4600-b729-a68a46ac13c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:54.417719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0de98-b683-4600-b729-a68a46ac13c7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.418000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0de98-b683-4600-b729-a68a46ac13c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.418331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0de98-b683-4600-b729-a68a46ac13c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.432269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0de98-b683-4600-b729-a68a46ac13c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-40f0de98-b683-4600-b729-a68a46ac13c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:54.437414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:54.438314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 16:56:54.439102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:54.442527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 213/436] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:54.445335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3542c47-939b-4133-9b9a-69d2e31e041e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:54.501131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0de98-b683-4600-b729-a68a46ac13c7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:54.523782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:54.536797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:54.594454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3542c47-939b-4133-9b9a-69d2e31e041e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:54.634516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0de98-b683-4600-b729-a68a46ac13c7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:54.647615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e891d6-5e32-4926-b85b-1a16bd73d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:54.648243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e891d6-5e32-4926-b85b-1a16bd73d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.648520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e891d6-5e32-4926-b85b-1a16bd73d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.648786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e891d6-5e32-4926-b85b-1a16bd73d7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.649503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e891d6-5e32-4926-b85b-1a16bd73d7e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:54.649802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e891d6-5e32-4926-b85b-1a16bd73d7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:54.651174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e891d6-5e32-4926-b85b-1a16bd73d7e8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:54.667060 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 224/437] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:56:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:54.672918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e891d6-5e32-4926-b85b-1a16bd73d7e8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:54.673468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9b0df-e5ad-4df3-9ad6-3413c404c058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:54.674173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9b0df-e5ad-4df3-9ad6-3413c404c058 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.674449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9b0df-e5ad-4df3-9ad6-3413c404c058 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.674770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9b0df-e5ad-4df3-9ad6-3413c404c058 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.691288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9b0df-e5ad-4df3-9ad6-3413c404c058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-41b9b0df-e5ad-4df3-9ad6-3413c404c058 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:54.696118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:54.697140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:54.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 214/438] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:56:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:54.699122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94395b94-d4a8-41bb-855f-8f6d4ea87d9c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.699122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94395b94-d4a8-41bb-855f-8f6d4ea87d9c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.699396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94395b94-d4a8-41bb-855f-8f6d4ea87d9c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.700662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 215/439] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:54.705296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94395b94-d4a8-41bb-855f-8f6d4ea87d9c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:54.788535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e891d6-5e32-4926-b85b-1a16bd73d7e8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:54.801492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:54.802881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:54.825756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310c1e3-cce3-413c-bc6b-66b5513e9bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:54.826608 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310c1e3-cce3-413c-bc6b-66b5513e9bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.827035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310c1e3-cce3-413c-bc6b-66b5513e9bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.827478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310c1e3-cce3-413c-bc6b-66b5513e9bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.830806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94395b94-d4a8-41bb-855f-8f6d4ea87d9c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:54.875084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5ca03-d266-4dc0-acc1-ab0abe91444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:54.875765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ca03-d266-4dc0-acc1-ab0abe91444f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.876044 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ca03-d266-4dc0-acc1-ab0abe91444f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.876307 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5ca03-d266-4dc0-acc1-ab0abe91444f None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.876977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5ca03-d266-4dc0-acc1-ab0abe91444f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:54.877339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5ca03-d266-4dc0-acc1-ab0abe91444f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:54.878702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5ca03-d266-4dc0-acc1-ab0abe91444f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:54.887383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 216/440] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:56:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:54.889685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7a1e-eebb-465c-8904-85b32e52259e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:54.889952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7a1e-eebb-465c-8904-85b32e52259e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:54.890222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7a1e-eebb-465c-8904-85b32e52259e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:54.909778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ca6b7a1e-eebb-465c-8904-85b32e52259e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:54.910974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ca6b7a1e-eebb-465c-8904-85b32e52259e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:54.913704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310c1e3-cce3-413c-bc6b-66b5513e9bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:54.915933 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310c1e3-cce3-413c-bc6b-66b5513e9bc9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:54.978702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 217/441] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:54.980303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7a1e-eebb-465c-8904-85b32e52259e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:55.019765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 225/442] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:56:55.026025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310c1e3-cce3-413c-bc6b-66b5513e9bc9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:55.043022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:55.059221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:55.084796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7a1e-eebb-465c-8904-85b32e52259e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:55.122877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985762b3-97e5-4e41-9a44-29cb65e01ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:55.123517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985762b3-97e5-4e41-9a44-29cb65e01ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:55.123756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985762b3-97e5-4e41-9a44-29cb65e01ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:55.124020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985762b3-97e5-4e41-9a44-29cb65e01ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:55.129927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310c1e3-cce3-413c-bc6b-66b5513e9bc9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:55.169343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6db31-fb5b-4b4a-ad98-70f2f8b3c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:55.170065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6db31-fb5b-4b4a-ad98-70f2f8b3c96c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:55.170348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6db31-fb5b-4b4a-ad98-70f2f8b3c96c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:55.170618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6db31-fb5b-4b4a-ad98-70f2f8b3c96c None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:55.171743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6db31-fb5b-4b4a-ad98-70f2f8b3c96c None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:55.173257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6db31-fb5b-4b4a-ad98-70f2f8b3c96c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:55.175187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 226/443] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:55 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:55.181221 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6db31-fb5b-4b4a-ad98-70f2f8b3c96c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:55.198260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985762b3-97e5-4e41-9a44-29cb65e01ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:55.200212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985762b3-97e5-4e41-9a44-29cb65e01ba0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:55.265418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:55.277698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:55.291885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6db31-fb5b-4b4a-ad98-70f2f8b3c96c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:55.308938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 218/444] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:56:55.309793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985762b3-97e5-4e41-9a44-29cb65e01ba0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:55.330226 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a663117-88d6-4e1d-9960-af89b82a5376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:55.330867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a663117-88d6-4e1d-9960-af89b82a5376 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:55.331142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a663117-88d6-4e1d-9960-af89b82a5376 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:55.331413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a663117-88d6-4e1d-9960-af89b82a5376 None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:55.332540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a663117-88d6-4e1d-9960-af89b82a5376 None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:55.334147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a663117-88d6-4e1d-9960-af89b82a5376 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:55.335732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 227/445] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:55 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:55.336483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a663117-88d6-4e1d-9960-af89b82a5376 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:55.408528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985762b3-97e5-4e41-9a44-29cb65e01ba0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:55.437550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a663117-88d6-4e1d-9960-af89b82a5376 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:55.443210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53fd77-cce8-4a6d-b473-800c5ab690a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:55.443845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53fd77-cce8-4a6d-b473-800c5ab690a9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:55.444128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53fd77-cce8-4a6d-b473-800c5ab690a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:55.444390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53fd77-cce8-4a6d-b473-800c5ab690a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:55.454814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc53fd77-cce8-4a6d-b473-800c5ab690a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-cc53fd77-cce8-4a6d-b473-800c5ab690a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:56:55.459725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:55.460669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 219/446] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:55.461719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53fd77-cce8-4a6d-b473-800c5ab690a9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:55.470935 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21f3c-f975-409c-8707-e57cfbcf0626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:55.471558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21f3c-f975-409c-8707-e57cfbcf0626 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:55.471832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21f3c-f975-409c-8707-e57cfbcf0626 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:55.472097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21f3c-f975-409c-8707-e57cfbcf0626 None admin] PATH_INFO: `/v3/projects/237f2ccd89da4522952fcbe9127d4d2c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:55.473248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c21f3c-f975-409c-8707-e57cfbcf0626 None admin] RBAC: Authorizing `identity:get_project(project_id=237f2ccd89da4522952fcbe9127d4d2c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:55.474706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c21f3c-f975-409c-8707-e57cfbcf0626 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:55.476337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 228/447] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:55 2022] GET /identity/v3/projects/237f2ccd89da4522952fcbe9127d4d2c => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:55.477125 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21f3c-f975-409c-8707-e57cfbcf0626 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:55.494609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:55.501216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:55.568433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53fd77-cce8-4a6d-b473-800c5ab690a9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:55.574308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21f3c-f975-409c-8707-e57cfbcf0626 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:55.603818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94c5e1-fa8e-47fb-8047-8189f4120ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:55.604524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c5e1-fa8e-47fb-8047-8189f4120ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:55.604874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c5e1-fa8e-47fb-8047-8189f4120ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:55.605235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c5e1-fa8e-47fb-8047-8189f4120ae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:55.606042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94c5e1-fa8e-47fb-8047-8189f4120ae5 None admin] RBAC: Adding query filter params (group.id=0cabd5c1ce7f41c58c0813884623163a, role.id=b86a73fa9cc046eeae600bffd4218e7b, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:55.606418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94c5e1-fa8e-47fb-8047-8189f4120ae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:55.606992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f35650-0601-4b20-a506-bfeb585f5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:55.607604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35650-0601-4b20-a506-bfeb585f5767 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:55.607882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35650-0601-4b20-a506-bfeb585f5767 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:55.607983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94c5e1-fa8e-47fb-8047-8189f4120ae5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:55.608156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f35650-0601-4b20-a506-bfeb585f5767 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:55.608822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f35650-0601-4b20-a506-bfeb585f5767 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:55.609163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f35650-0601-4b20-a506-bfeb585f5767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:55.611137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f35650-0601-4b20-a506-bfeb585f5767 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:55.613760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 220/448] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Sep 19 16:56:55 2022] GET /identity/v3/role_assignments?group.id=0cabd5c1ce7f41c58c0813884623163a&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=b86a73fa9cc046eeae600bffd4218e7b => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:55.614562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94c5e1-fa8e-47fb-8047-8189f4120ae5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:55.633796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 229/449] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:55.639778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f35650-0601-4b20-a506-bfeb585f5767 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:55.729700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:55.730359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:55.734669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94c5e1-fa8e-47fb-8047-8189f4120ae5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:55.752203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f35650-0601-4b20-a506-bfeb585f5767 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:55.777196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334a081-b787-4f98-b906-d598fda963b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:55.777856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334a081-b787-4f98-b906-d598fda963b5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:55.778142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334a081-b787-4f98-b906-d598fda963b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:55.778421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334a081-b787-4f98-b906-d598fda963b5 None admin] PATH_INFO: `/v3/groups/0cabd5c1ce7f41c58c0813884623163a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:55.779678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334a081-b787-4f98-b906-d598fda963b5 None admin] RBAC: Authorizing `identity:get_group(group_id=0cabd5c1ce7f41c58c0813884623163a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:55.781312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334a081-b787-4f98-b906-d598fda963b5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:55.782966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 221/450] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:55 2022] GET /identity/v3/groups/0cabd5c1ce7f41c58c0813884623163a => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:55.788870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334a081-b787-4f98-b906-d598fda963b5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:55.789701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b58df-b858-4d22-92f3-001d1e61d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:55.790331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b58df-b858-4d22-92f3-001d1e61d2fe None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:55.790632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b58df-b858-4d22-92f3-001d1e61d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:55.791304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b58df-b858-4d22-92f3-001d1e61d2fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:55.878467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b58df-b858-4d22-92f3-001d1e61d2fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:55.880499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b58df-b858-4d22-92f3-001d1e61d2fe None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:55.902596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334a081-b787-4f98-b906-d598fda963b5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:55.939107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a54f8-c674-4acb-b0b8-6ec0afd0794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:55.939720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a54f8-c674-4acb-b0b8-6ec0afd0794a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:55.940122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a54f8-c674-4acb-b0b8-6ec0afd0794a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:55.940397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a54f8-c674-4acb-b0b8-6ec0afd0794a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:55.941177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a54f8-c674-4acb-b0b8-6ec0afd0794a None admin] RBAC: Adding query filter params (group.id=0cabd5c1ce7f41c58c0813884623163a, role.id=ee6045909540420b8b406a308fdad516, scope.project.id=237f2ccd89da4522952fcbe9127d4d2c) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:55.941489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a54f8-c674-4acb-b0b8-6ec0afd0794a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:55.943015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a54f8-c674-4acb-b0b8-6ec0afd0794a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:55.949813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 222/451] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Sep 19 16:56:55 2022] GET /identity/v3/role_assignments?group.id=0cabd5c1ce7f41c58c0813884623163a&scope.project.id=237f2ccd89da4522952fcbe9127d4d2c&role.id=ee6045909540420b8b406a308fdad516 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:56:55.973757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:55.998724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 230/452] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 16:56:56.004135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a54f8-c674-4acb-b0b8-6ec0afd0794a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:56.039578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:56.114966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a54f8-c674-4acb-b0b8-6ec0afd0794a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:56.153872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cce0b6-2342-455f-a0fc-0eb624f05659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:56.154521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cce0b6-2342-455f-a0fc-0eb624f05659 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:56.154806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cce0b6-2342-455f-a0fc-0eb624f05659 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:56.155076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cce0b6-2342-455f-a0fc-0eb624f05659 None admin] PATH_INFO: `/v3/projects/1401206b2abd4d4db9b2a1ade1bdd499` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:56.156245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cce0b6-2342-455f-a0fc-0eb624f05659 None admin] RBAC: Authorizing `identity:get_project(project_id=1401206b2abd4d4db9b2a1ade1bdd499)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:56.157739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cce0b6-2342-455f-a0fc-0eb624f05659 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:56.159535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 223/453] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:56:56 2022] GET /identity/v3/projects/1401206b2abd4d4db9b2a1ade1bdd499 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:56.165167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b58df-b858-4d22-92f3-001d1e61d2fe None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:56.265847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b58df-b858-4d22-92f3-001d1e61d2fe None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:56.300133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039adee6-3001-4bf6-a6c9-28449bd54d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:56.300770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039adee6-3001-4bf6-a6c9-28449bd54d5e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:56.301068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039adee6-3001-4bf6-a6c9-28449bd54d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:56.301346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039adee6-3001-4bf6-a6c9-28449bd54d5e None admin] PATH_INFO: `/v3/groups/4c88c203bae548429558904e7a4de6a1` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:56.302530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039adee6-3001-4bf6-a6c9-28449bd54d5e None admin] RBAC: Authorizing `identity:get_group(group_id=4c88c203bae548429558904e7a4de6a1)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:56.304028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039adee6-3001-4bf6-a6c9-28449bd54d5e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:56.305638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 231/454] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Sep 19 16:56:56 2022] GET /identity/v3/groups/4c88c203bae548429558904e7a4de6a1 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:56.311632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cce0b6-2342-455f-a0fc-0eb624f05659 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:56.425192 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:56.429939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cce0b6-2342-455f-a0fc-0eb624f05659 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:56.465191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48029ab5-59a9-4acb-b418-eb0af68fa6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:56.465789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48029ab5-59a9-4acb-b418-eb0af68fa6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:56.466067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48029ab5-59a9-4acb-b418-eb0af68fa6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:56.466338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48029ab5-59a9-4acb-b418-eb0af68fa6a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:56.467073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48029ab5-59a9-4acb-b418-eb0af68fa6a3 None admin] RBAC: Adding query filter params (group.id=4c88c203bae548429558904e7a4de6a1, role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=1401206b2abd4d4db9b2a1ade1bdd499) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:56.467377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48029ab5-59a9-4acb-b418-eb0af68fa6a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:56.468825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48029ab5-59a9-4acb-b418-eb0af68fa6a3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:56.474690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 224/455] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Sep 19 16:56:56 2022] GET /identity/v3/role_assignments?group.id=4c88c203bae548429558904e7a4de6a1&scope.project.id=1401206b2abd4d4db9b2a1ade1bdd499&role.id=77285ef607e34662b6234656fe8043d0 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:58.957080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dd28e-c854-4c68-aedb-c74acf01b1b3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:58.957607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dd28e-c854-4c68-aedb-c74acf01b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:58.957607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dd28e-c854-4c68-aedb-c74acf01b1b3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:58.959230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 232/456] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:58.964758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a2c5f-8291-4caf-a62a-c9c87c119ead None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:58.965173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a2c5f-8291-4caf-a62a-c9c87c119ead None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:58.965333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a2c5f-8291-4caf-a62a-c9c87c119ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:58.994036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-316a2c5f-8291-4caf-a62a-c9c87c119ead None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:58.995244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-316a2c5f-8291-4caf-a62a-c9c87c119ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:59.087315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 225/457] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:59.378045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc73c9-e418-4871-b58b-862d906fda8a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:59.378443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc73c9-e418-4871-b58b-862d906fda8a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:59.378628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc73c9-e418-4871-b58b-862d906fda8a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:59.380243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 233/458] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:59.385237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83370a77-1544-4ad0-98c3-3ce1872e5ead None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:59.385529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83370a77-1544-4ad0-98c3-3ce1872e5ead None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:59.385806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83370a77-1544-4ad0-98c3-3ce1872e5ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:59.411692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-83370a77-1544-4ad0-98c3-3ce1872e5ead None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:59.412886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-83370a77-1544-4ad0-98c3-3ce1872e5ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:59.420057 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc73c9-e418-4871-b58b-862d906fda8a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:59.483652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:59.497887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 226/459] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:59.499224 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94d70f-8d00-4804-aa8a-477a45b29e64 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:59.499450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94d70f-8d00-4804-aa8a-477a45b29e64 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:59.499728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94d70f-8d00-4804-aa8a-477a45b29e64 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:59.501260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 227/460] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:59.506993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c85f7-1974-4f03-8b8b-a6b3cccf1f66 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:59.507697 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c85f7-1974-4f03-8b8b-a6b3cccf1f66 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:59.508121 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c85f7-1974-4f03-8b8b-a6b3cccf1f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:59.543187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-016c85f7-1974-4f03-8b8b-a6b3cccf1f66 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:59.544395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-016c85f7-1974-4f03-8b8b-a6b3cccf1f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:59.577628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc73c9-e418-4871-b58b-862d906fda8a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:59.580198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:59.654776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1c39-64b5-4e2d-a01e-50370422fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:59.655341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1c39-64b5-4e2d-a01e-50370422fe02 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:59.659121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1c39-64b5-4e2d-a01e-50370422fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:59.659422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1c39-64b5-4e2d-a01e-50370422fe02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:59.661315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 228/461] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:59.675685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea1c39-64b5-4e2d-a01e-50370422fe02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:59.677200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea1c39-64b5-4e2d-a01e-50370422fe02 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6bea1c39-64b5-4e2d-a01e-50370422fe02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:56:59.692065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:56:59.693887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:56:59.695234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:56:59.695234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:56:59.695234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:56:59.695234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 234/462] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:56:59.702193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c85f7-1974-4f03-8b8b-a6b3cccf1f66 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:59.736267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4c05e-ad0c-40f6-ae70-3f4af0bcbd27 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:59.736545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4c05e-ad0c-40f6-ae70-3f4af0bcbd27 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:59.736821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4c05e-ad0c-40f6-ae70-3f4af0bcbd27 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:59.738463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 235/463] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:56:59.743533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21787b38-768a-40f6-94ab-ba2ee42e7c47 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:59.743814 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21787b38-768a-40f6-94ab-ba2ee42e7c47 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:59.744082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21787b38-768a-40f6-94ab-ba2ee42e7c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:59.784544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-21787b38-768a-40f6-94ab-ba2ee42e7c47 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:56:59.785772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-21787b38-768a-40f6-94ab-ba2ee42e7c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:56:59.834891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c85f7-1974-4f03-8b8b-a6b3cccf1f66 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:56:59.869679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43b591-9858-4f9c-bf3f-4f6d6802eb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:56:59.870289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43b591-9858-4f9c-bf3f-4f6d6802eb92 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:56:59.870564 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43b591-9858-4f9c-bf3f-4f6d6802eb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:56:59.870833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43b591-9858-4f9c-bf3f-4f6d6802eb92 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:56:59.871475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43b591-9858-4f9c-bf3f-4f6d6802eb92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:56:59.871780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43b591-9858-4f9c-bf3f-4f6d6802eb92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:56:59.873182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43b591-9858-4f9c-bf3f-4f6d6802eb92 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:56:59.881687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 236/464] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:56:59.882703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21787b38-768a-40f6-94ab-ba2ee42e7c47 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:59.885336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 229/465] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:56:59.893980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43b591-9858-4f9c-bf3f-4f6d6802eb92 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:56:59.921779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:56:59.928829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:00.018643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21787b38-768a-40f6-94ab-ba2ee42e7c47 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:00.052454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43b591-9858-4f9c-bf3f-4f6d6802eb92 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:00.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7b046-eb89-41bd-835d-7e86495dd36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:00.069691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7b046-eb89-41bd-835d-7e86495dd36b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.070236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7b046-eb89-41bd-835d-7e86495dd36b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.071143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7b046-eb89-41bd-835d-7e86495dd36b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.085398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7b046-eb89-41bd-835d-7e86495dd36b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:00.088034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7b046-eb89-41bd-835d-7e86495dd36b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:00.091410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03124a3c-0891-46ad-9726-2c86414c200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:00.092022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03124a3c-0891-46ad-9726-2c86414c200b None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.092297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03124a3c-0891-46ad-9726-2c86414c200b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.092563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03124a3c-0891-46ad-9726-2c86414c200b None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.093297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03124a3c-0891-46ad-9726-2c86414c200b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:00.094758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03124a3c-0891-46ad-9726-2c86414c200b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c9c7b046-eb89-41bd-835d-7e86495dd36b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:00.105757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:00.106712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:00.107647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:00.107647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:00.107647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:00.107647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 237/466] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:00.108357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7b046-eb89-41bd-835d-7e86495dd36b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:00.123103 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 230/467] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:56:59 2022] POST /identity/v3/users => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:00.124315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03124a3c-0891-46ad-9726-2c86414c200b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:00.229625 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:00.239834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:00.255397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7b046-eb89-41bd-835d-7e86495dd36b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:00.287526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03124a3c-0891-46ad-9726-2c86414c200b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:00.299138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eba459-829e-4c16-9361-956d5ee4e337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:00.300263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba459-829e-4c16-9361-956d5ee4e337 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.300543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba459-829e-4c16-9361-956d5ee4e337 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.300817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba459-829e-4c16-9361-956d5ee4e337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.317134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eba459-829e-4c16-9361-956d5ee4e337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:00.319044 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eba459-829e-4c16-9361-956d5ee4e337 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-52eba459-829e-4c16-9361-956d5ee4e337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:00.334628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:00.335701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:00.336530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:00.336530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:00.336530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:00.339358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ffbf5-56b0-4c45-a42b-4af2b816c64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:00.339987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ffbf5-56b0-4c45-a42b-4af2b816c64e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.340272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ffbf5-56b0-4c45-a42b-4af2b816c64e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.340544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ffbf5-56b0-4c45-a42b-4af2b816c64e None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.340777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 238/468] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:00.341877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ffbf5-56b0-4c45-a42b-4af2b816c64e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:00.341877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ffbf5-56b0-4c45-a42b-4af2b816c64e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:00.342033 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eba459-829e-4c16-9361-956d5ee4e337 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:00.342922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ffbf5-56b0-4c45-a42b-4af2b816c64e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:00.360445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 231/469] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:00.361908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ffbf5-56b0-4c45-a42b-4af2b816c64e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:00.486592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ffbf5-56b0-4c45-a42b-4af2b816c64e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:00.489950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eba459-829e-4c16-9361-956d5ee4e337 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:00.516529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:00.526419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f657b3-c586-4f83-97ce-d5e96b769b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:00.527039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f657b3-c586-4f83-97ce-d5e96b769b8c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.527328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f657b3-c586-4f83-97ce-d5e96b769b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.527609 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f657b3-c586-4f83-97ce-d5e96b769b8c None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.528269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f657b3-c586-4f83-97ce-d5e96b769b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:00.528578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f657b3-c586-4f83-97ce-d5e96b769b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:00.530383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f657b3-c586-4f83-97ce-d5e96b769b8c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:00.532189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78778663-318b-477d-adcc-13cf44cf4813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:00.533303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78778663-318b-477d-adcc-13cf44cf4813 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.533588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78778663-318b-477d-adcc-13cf44cf4813 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.533861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78778663-318b-477d-adcc-13cf44cf4813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.535806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:00.545149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 232/470] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:00.546015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f657b3-c586-4f83-97ce-d5e96b769b8c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:00.551149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78778663-318b-477d-adcc-13cf44cf4813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:00.552916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78778663-318b-477d-adcc-13cf44cf4813 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-78778663-318b-477d-adcc-13cf44cf4813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:00.570389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:00.571336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:00.572201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:00.572201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:00.572201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:00.572201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 239/471] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:00.572830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78778663-318b-477d-adcc-13cf44cf4813 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:00.667175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f657b3-c586-4f83-97ce-d5e96b769b8c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:00.684075 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78778663-318b-477d-adcc-13cf44cf4813 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:00.706312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a32f9-f0e4-4dee-a6ff-d4c1439c29c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:00.706943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a32f9-f0e4-4dee-a6ff-d4c1439c29c9 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.707229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a32f9-f0e4-4dee-a6ff-d4c1439c29c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.707507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a32f9-f0e4-4dee-a6ff-d4c1439c29c9 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.708328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a32f9-f0e4-4dee-a6ff-d4c1439c29c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:00.710868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a32f9-f0e4-4dee-a6ff-d4c1439c29c9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:00.729982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ad9a-f31b-4be9-a879-51affd08cfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:00.730659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ad9a-f31b-4be9-a879-51affd08cfdb None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.730936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ad9a-f31b-4be9-a879-51affd08cfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.731204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ad9a-f31b-4be9-a879-51affd08cfdb None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.732061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28ad9a-f31b-4be9-a879-51affd08cfdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:00.734137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28ad9a-f31b-4be9-a879-51affd08cfdb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:00.739939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 233/472] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:57:00 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:00.740740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a32f9-f0e4-4dee-a6ff-d4c1439c29c9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:00.772099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 240/473] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:57:00 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:00.826229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bee8f-6f56-4e18-82fe-482068354831 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.826581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bee8f-6f56-4e18-82fe-482068354831 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.826793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bee8f-6f56-4e18-82fe-482068354831 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.828485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 241/474] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:00.831988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:00.834400 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b850949-c0d8-4f30-9393-68bd1b097974 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.834678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b850949-c0d8-4f30-9393-68bd1b097974 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.834946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b850949-c0d8-4f30-9393-68bd1b097974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.858173 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8b850949-c0d8-4f30-9393-68bd1b097974 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:00.860353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8b850949-c0d8-4f30-9393-68bd1b097974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:00.889675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a32f9-f0e4-4dee-a6ff-d4c1439c29c9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:00.909859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:00.933468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569a698-ebad-46cd-98c0-758717c9ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:00.934109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569a698-ebad-46cd-98c0-758717c9ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:00.934389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569a698-ebad-46cd-98c0-758717c9ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:00.934675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569a698-ebad-46cd-98c0-758717c9ecb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:00.935455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569a698-ebad-46cd-98c0-758717c9ecb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:00.935768 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569a698-ebad-46cd-98c0-758717c9ecb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:00.938226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569a698-ebad-46cd-98c0-758717c9ecb8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:00.952848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 242/475] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:57:00.957093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 234/476] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:00.962226 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b850949-c0d8-4f30-9393-68bd1b097974 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:01.089648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b850949-c0d8-4f30-9393-68bd1b097974 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:01.128456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c1870-62c1-4a3f-9443-179f0669df7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:01.129105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c1870-62c1-4a3f-9443-179f0669df7f None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:01.129387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c1870-62c1-4a3f-9443-179f0669df7f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:01.129657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c1870-62c1-4a3f-9443-179f0669df7f None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:01.130394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c1870-62c1-4a3f-9443-179f0669df7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:01.131833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c1870-62c1-4a3f-9443-179f0669df7f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:01.160702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 243/477] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:57:00 2022] POST /identity/v3/users => generated 249 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:01.248473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569a698-ebad-46cd-98c0-758717c9ecb8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:01.377209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569a698-ebad-46cd-98c0-758717c9ecb8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:01.379450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:01.413243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02932530-bb11-4a99-930b-13679d84dbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:01.413874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02932530-bb11-4a99-930b-13679d84dbbf None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:01.414153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02932530-bb11-4a99-930b-13679d84dbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:01.414420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02932530-bb11-4a99-930b-13679d84dbbf None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:01.415108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02932530-bb11-4a99-930b-13679d84dbbf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:01.416509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02932530-bb11-4a99-930b-13679d84dbbf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:01.427455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.sql.core [None req-02932530-bb11-4a99-930b-13679d84dbbf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 16:57:01.427455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 16:57:01.427455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [parameters: {'id': 'cdb0d6f6d52d46e3ad018bbb36b2b9f4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 16:57:01.427455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81585) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-02932530-bb11-4a99-930b-13679d84dbbf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Sep 19 16:57:01.444322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return ref.to_dict() Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:57:01.445265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application yield resource Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise self.value Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application session.commit() Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 16:57:01.446243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.session.flush() Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application compat.raise_( Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 16:57:01.447707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:57:01.449480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application result.read() Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:57:01.451409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [parameters: {'id': 'cdb0d6f6d52d46e3ad018bbb36b2b9f4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:01.453549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 16:57:01.455332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:01.457347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 235/478] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Sep 19 16:57:01 2022] POST /identity/v3/roles => generated 144 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:01.457495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c1870-62c1-4a3f-9443-179f0669df7f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:01.482543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:01.570209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c1870-62c1-4a3f-9443-179f0669df7f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:01.605573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c124e8-1fa1-4d66-b550-6a74e75a15bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:01.606264 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c124e8-1fa1-4d66-b550-6a74e75a15bd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:01.606547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c124e8-1fa1-4d66-b550-6a74e75a15bd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:01.606811 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c124e8-1fa1-4d66-b550-6a74e75a15bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:01.628256 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c124e8-1fa1-4d66-b550-6a74e75a15bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-09c124e8-1fa1-4d66-b550-6a74e75a15bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:01.638381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:01.639277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:01.640055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 244/479] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:57:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:01.645852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02932530-bb11-4a99-930b-13679d84dbbf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:01.817168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02932530-bb11-4a99-930b-13679d84dbbf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:01.870635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1baeb6-0c22-4535-9229-b2c1e9a881e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:01.871661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1baeb6-0c22-4535-9229-b2c1e9a881e7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:01.872129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1baeb6-0c22-4535-9229-b2c1e9a881e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:01.872583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1baeb6-0c22-4535-9229-b2c1e9a881e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:01.873473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1baeb6-0c22-4535-9229-b2c1e9a881e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:01.873963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1baeb6-0c22-4535-9229-b2c1e9a881e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:01.875571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1baeb6-0c22-4535-9229-b2c1e9a881e7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:01.888404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 236/480] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:02.863431 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81dfa4-0ca9-4399-bfde-c4f146734eed None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:02.863950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81dfa4-0ca9-4399-bfde-c4f146734eed None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:02.864259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81dfa4-0ca9-4399-bfde-c4f146734eed None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:02.865973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 245/481] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:02.871637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222c90b-bb5a-4e1c-a7ce-140f8e3cac39 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:02.872058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222c90b-bb5a-4e1c-a7ce-140f8e3cac39 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:02.872226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222c90b-bb5a-4e1c-a7ce-140f8e3cac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:02.898048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7222c90b-bb5a-4e1c-a7ce-140f8e3cac39 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:02.899257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7222c90b-bb5a-4e1c-a7ce-140f8e3cac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:02.923997 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:02.983514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 237/482] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:57:03.281783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81dfa4-0ca9-4399-bfde-c4f146734eed None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:03.410219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:03.429288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81dfa4-0ca9-4399-bfde-c4f146734eed None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:03.483529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57942be-ca75-4006-9e67-13448e5124f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:03.484241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57942be-ca75-4006-9e67-13448e5124f8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:03.484518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57942be-ca75-4006-9e67-13448e5124f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:03.484783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57942be-ca75-4006-9e67-13448e5124f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:03.500502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57942be-ca75-4006-9e67-13448e5124f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c57942be-ca75-4006-9e67-13448e5124f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:03.505385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:03.506274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:03.507094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 246/483] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:03.514120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222c90b-bb5a-4e1c-a7ce-140f8e3cac39 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:03.539192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76e41c-b07d-411d-8087-21c778f3bef9 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:03.539495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76e41c-b07d-411d-8087-21c778f3bef9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:03.539721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76e41c-b07d-411d-8087-21c778f3bef9 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:03.541335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 247/484] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:03.560755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1f26-2d7d-44e4-ae15-d853355056ea None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:03.560755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1f26-2d7d-44e4-ae15-d853355056ea None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:03.560755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1f26-2d7d-44e4-ae15-d853355056ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:03.595370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6ecb1f26-2d7d-44e4-ae15-d853355056ea None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:03.596580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6ecb1f26-2d7d-44e4-ae15-d853355056ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:03.642894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222c90b-bb5a-4e1c-a7ce-140f8e3cac39 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:03.683125 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 248/485] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:57:03.684599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb33ef1-0f35-41b9-a152-de0f03e4460d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:03.684891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb33ef1-0f35-41b9-a152-de0f03e4460d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:03.685190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb33ef1-0f35-41b9-a152-de0f03e4460d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:03.685795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0daf67-cac7-4f60-8041-6797a3acb966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:03.686643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 249/486] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:03.686862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0daf67-cac7-4f60-8041-6797a3acb966 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:03.687326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0daf67-cac7-4f60-8041-6797a3acb966 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:03.687851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0daf67-cac7-4f60-8041-6797a3acb966 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:03.688714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0daf67-cac7-4f60-8041-6797a3acb966 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:03.689252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0daf67-cac7-4f60-8041-6797a3acb966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:03.690821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0daf67-cac7-4f60-8041-6797a3acb966 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:03.698195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f34968-30b2-4861-b138-2526f8e2bdaa None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:03.698475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f34968-30b2-4861-b138-2526f8e2bdaa None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:03.698745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f34968-30b2-4861-b138-2526f8e2bdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:03.700774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 238/487] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:03.706599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0daf67-cac7-4f60-8041-6797a3acb966 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:03.727337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c0f34968-30b2-4861-b138-2526f8e2bdaa None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:03.727337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c0f34968-30b2-4861-b138-2526f8e2bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:03.758087 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:03.804033 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 250/488] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:03.896204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0daf67-cac7-4f60-8041-6797a3acb966 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:03.934724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d1f32-a6aa-40c2-bb9a-a2706a2c1e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:03.935298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d1f32-a6aa-40c2-bb9a-a2706a2c1e86 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:03.935578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d1f32-a6aa-40c2-bb9a-a2706a2c1e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:03.935856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d1f32-a6aa-40c2-bb9a-a2706a2c1e86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:03.947783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d1f32-a6aa-40c2-bb9a-a2706a2c1e86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:03.949286 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d1f32-a6aa-40c2-bb9a-a2706a2c1e86 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f84d1f32-a6aa-40c2-bb9a-a2706a2c1e86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:03.964761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:03.965776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:03.966600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:03.966600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:03.966600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:03.966600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 239/489] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:03.972978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f34968-30b2-4861-b138-2526f8e2bdaa None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:03.990036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d1f32-a6aa-40c2-bb9a-a2706a2c1e86 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:03.992031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:04.094316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:04.121200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d1f32-a6aa-40c2-bb9a-a2706a2c1e86 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:04.131188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f34968-30b2-4861-b138-2526f8e2bdaa None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:04.160022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d2698-1174-4308-9ba7-77eefa24ad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:04.160674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d2698-1174-4308-9ba7-77eefa24ad20 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.160956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d2698-1174-4308-9ba7-77eefa24ad20 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.161261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d2698-1174-4308-9ba7-77eefa24ad20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.172753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d2698-1174-4308-9ba7-77eefa24ad20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:04.178052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199fd86-5fb9-4578-aab2-3950a2f7de86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ce7d2698-1174-4308-9ba7-77eefa24ad20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:04.178184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:04.179011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:04.185295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 240/490] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:04.185965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fd86-5fb9-4578-aab2-3950a2f7de86 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.185965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fd86-5fb9-4578-aab2-3950a2f7de86 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.186086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a4817-7613-4f00-885d-588f4223128d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.186149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fd86-5fb9-4578-aab2-3950a2f7de86 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.186219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a4817-7613-4f00-885d-588f4223128d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.186219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a4817-7613-4f00-885d-588f4223128d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.186351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199fd86-5fb9-4578-aab2-3950a2f7de86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:04.186351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199fd86-5fb9-4578-aab2-3950a2f7de86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:04.186472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 241/491] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:04.186544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199fd86-5fb9-4578-aab2-3950a2f7de86 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:04.186609 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a4817-7613-4f00-885d-588f4223128d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:04.199544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 251/492] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:04.200543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199fd86-5fb9-4578-aab2-3950a2f7de86 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:04.265787 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:04.289427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a4817-7613-4f00-885d-588f4223128d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:04.300116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199fd86-5fb9-4578-aab2-3950a2f7de86 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:04.324289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39428efd-cd6b-4dff-9386-6addde880948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:04.325194 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428efd-cd6b-4dff-9386-6addde880948 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.325861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428efd-cd6b-4dff-9386-6addde880948 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.326147 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428efd-cd6b-4dff-9386-6addde880948 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.328696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:04.334116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafc4a1-006e-4671-9ef5-c71ed86f45f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:04.334768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafc4a1-006e-4671-9ef5-c71ed86f45f9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.335047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafc4a1-006e-4671-9ef5-c71ed86f45f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.335316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafc4a1-006e-4671-9ef5-c71ed86f45f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.335984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafc4a1-006e-4671-9ef5-c71ed86f45f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:04.336285 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafc4a1-006e-4671-9ef5-c71ed86f45f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:04.337705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafc4a1-006e-4671-9ef5-c71ed86f45f9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:04.338464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39428efd-cd6b-4dff-9386-6addde880948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-39428efd-cd6b-4dff-9386-6addde880948 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:04.344729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:04.345644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 242/493] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:04.351612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5e95-9829-4848-b933-f23d962c43a3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.352473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5e95-9829-4848-b933-f23d962c43a3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.352473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a5e95-9829-4848-b933-f23d962c43a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.352612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 252/494] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:04.352612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafc4a1-006e-4671-9ef5-c71ed86f45f9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:04.369524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ed3a5e95-9829-4848-b933-f23d962c43a3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:04.370746 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ed3a5e95-9829-4848-b933-f23d962c43a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:04.451541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 243/495] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:04.452532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5e95-9829-4848-b933-f23d962c43a3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:04.464143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafc4a1-006e-4671-9ef5-c71ed86f45f9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:04.504311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:04.508077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfcd5d-2084-41d7-97ed-0ec703f69c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:04.508852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfcd5d-2084-41d7-97ed-0ec703f69c02 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.509224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfcd5d-2084-41d7-97ed-0ec703f69c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.509558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfcd5d-2084-41d7-97ed-0ec703f69c02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.519425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfcd5d-2084-41d7-97ed-0ec703f69c02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:04.521904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfcd5d-2084-41d7-97ed-0ec703f69c02 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-51bfcd5d-2084-41d7-97ed-0ec703f69c02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:04.539695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:04.541062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:04.541938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:04.541938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:04.541938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:04.541938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:04.541938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:04.541938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:04.541938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:04.541938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:04.541938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:04.541938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:04.544680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 253/496] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Sep 19 16:57:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:04.546004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfcd5d-2084-41d7-97ed-0ec703f69c02 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:04.577783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a5e95-9829-4848-b933-f23d962c43a3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:04.603813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:04.617673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec210d-229e-4d19-a59f-18ef206c96f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:04.618465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec210d-229e-4d19-a59f-18ef206c96f1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.618837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec210d-229e-4d19-a59f-18ef206c96f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.619203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec210d-229e-4d19-a59f-18ef206c96f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.619980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec210d-229e-4d19-a59f-18ef206c96f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:04.620390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec210d-229e-4d19-a59f-18ef206c96f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:04.621947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec210d-229e-4d19-a59f-18ef206c96f1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:04.635982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 244/497] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:04.637060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec210d-229e-4d19-a59f-18ef206c96f1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:04.672431 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfcd5d-2084-41d7-97ed-0ec703f69c02 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:04.707543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66218-529f-4c69-9eea-c63ec52771f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:04.708093 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66218-529f-4c69-9eea-c63ec52771f8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.708692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66218-529f-4c69-9eea-c63ec52771f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.708965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66218-529f-4c69-9eea-c63ec52771f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.722631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb66218-529f-4c69-9eea-c63ec52771f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:04.724152 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb66218-529f-4c69-9eea-c63ec52771f8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3eb66218-529f-4c69-9eea-c63ec52771f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:04.738260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:04.739136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:04.740023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:04.740023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:04.740023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:04.740023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 254/498] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:04.740957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66218-529f-4c69-9eea-c63ec52771f8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:04.749933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec210d-229e-4d19-a59f-18ef206c96f1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:04.783856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a02c2c-c3e1-47a0-8e56-b2b5e8267240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:04.784461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02c2c-c3e1-47a0-8e56-b2b5e8267240 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.784735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02c2c-c3e1-47a0-8e56-b2b5e8267240 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.784998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02c2c-c3e1-47a0-8e56-b2b5e8267240 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.785688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:04.785799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a02c2c-c3e1-47a0-8e56-b2b5e8267240 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:04.786039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a02c2c-c3e1-47a0-8e56-b2b5e8267240 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:04.787593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a02c2c-c3e1-47a0-8e56-b2b5e8267240 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:04.823419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 245/499] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Sep 19 16:57:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:04.824474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7972e7-e8bb-4f13-a138-bd27700c9c62 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.824757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7972e7-e8bb-4f13-a138-bd27700c9c62 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.825026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7972e7-e8bb-4f13-a138-bd27700c9c62 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.827077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 246/500] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:04.827932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7972e7-e8bb-4f13-a138-bd27700c9c62 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:04.846950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66218-529f-4c69-9eea-c63ec52771f8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:04.874872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:04.880176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc707f26-ed7f-40fa-98c8-4decef015c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:04.880806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc707f26-ed7f-40fa-98c8-4decef015c48 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.881116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc707f26-ed7f-40fa-98c8-4decef015c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.881391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc707f26-ed7f-40fa-98c8-4decef015c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.891801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc707f26-ed7f-40fa-98c8-4decef015c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:04.893278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc707f26-ed7f-40fa-98c8-4decef015c48 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-fc707f26-ed7f-40fa-98c8-4decef015c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:04.907244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:04.908351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:04.909423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:04.909423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:04.909423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:04.909423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 255/501] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:04.910506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc707f26-ed7f-40fa-98c8-4decef015c48 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:04.931299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7972e7-e8bb-4f13-a138-bd27700c9c62 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:04.965957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc7de-8bda-404a-9e6c-64b9d4629aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:04.966479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc7de-8bda-404a-9e6c-64b9d4629aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:04.966760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc7de-8bda-404a-9e6c-64b9d4629aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:04.967031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc7de-8bda-404a-9e6c-64b9d4629aa3 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:04.967679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dc7de-8bda-404a-9e6c-64b9d4629aa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:04.967970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dc7de-8bda-404a-9e6c-64b9d4629aa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:04.969393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dc7de-8bda-404a-9e6c-64b9d4629aa3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:04.980675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 247/502] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:04.981495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc7de-8bda-404a-9e6c-64b9d4629aa3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.003247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:05.009985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc707f26-ed7f-40fa-98c8-4decef015c48 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.043179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc6bdf-4c54-4831-ade9-8da652062326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.043806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6bdf-4c54-4831-ade9-8da652062326 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.044082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6bdf-4c54-4831-ade9-8da652062326 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.044348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc6bdf-4c54-4831-ade9-8da652062326 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.054079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc6bdf-4c54-4831-ade9-8da652062326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-22dc6bdf-4c54-4831-ade9-8da652062326 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:05.059284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:05.060167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:05.060982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 256/503] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:05.062103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c610b-af71-4a0b-9708-6a8f075e6358 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.062103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c610b-af71-4a0b-9708-6a8f075e6358 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.062103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c610b-af71-4a0b-9708-6a8f075e6358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.076200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc7de-8bda-404a-9e6c-64b9d4629aa3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.078507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:05.079682 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-102c610b-af71-4a0b-9708-6a8f075e6358 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:05.080906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-102c610b-af71-4a0b-9708-6a8f075e6358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:05.110445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94add1-bbe1-4dca-a2ce-a6215baa078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.111059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94add1-bbe1-4dca-a2ce-a6215baa078a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.111341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94add1-bbe1-4dca-a2ce-a6215baa078a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.111636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94add1-bbe1-4dca-a2ce-a6215baa078a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.145776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 257/504] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:05.146617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c610b-af71-4a0b-9708-6a8f075e6358 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.181426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94add1-bbe1-4dca-a2ce-a6215baa078a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:05.182980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94add1-bbe1-4dca-a2ce-a6215baa078a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:05.233761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:05.251671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c610b-af71-4a0b-9708-6a8f075e6358 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.285091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 248/505] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:05.287121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a532a-bd4c-400e-ba66-5321c02c70f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.287726 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a532a-bd4c-400e-ba66-5321c02c70f6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.287997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a532a-bd4c-400e-ba66-5321c02c70f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.288262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a532a-bd4c-400e-ba66-5321c02c70f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.288901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a532a-bd4c-400e-ba66-5321c02c70f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:05.289234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a532a-bd4c-400e-ba66-5321c02c70f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:05.290596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a532a-bd4c-400e-ba66-5321c02c70f6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:05.290700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94add1-bbe1-4dca-a2ce-a6215baa078a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.293891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:05.304675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 258/506] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:05.305617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a532a-bd4c-400e-ba66-5321c02c70f6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.388708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94add1-bbe1-4dca-a2ce-a6215baa078a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.408509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a532a-bd4c-400e-ba66-5321c02c70f6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.422420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cb46f-57a6-4675-a11e-3a8f47d9a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.423050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cb46f-57a6-4675-a11e-3a8f47d9a042 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.423329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cb46f-57a6-4675-a11e-3a8f47d9a042 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.423578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cb46f-57a6-4675-a11e-3a8f47d9a042 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.431018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cb46f-57a6-4675-a11e-3a8f47d9a042 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:05.432439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cb46f-57a6-4675-a11e-3a8f47d9a042 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:05.444033 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98689de-cc1e-42d3-98f0-337ed85fa2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-fa5cb46f-57a6-4675-a11e-3a8f47d9a042 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:05.444532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:05.445526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:05.446600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:05.446600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:05.446600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:05.446600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:05.446600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:05.446600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:05.446600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:05.446600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:05.446600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:57:05.446600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:05.447288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98689de-cc1e-42d3-98f0-337ed85fa2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.447288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98689de-cc1e-42d3-98f0-337ed85fa2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.447288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98689de-cc1e-42d3-98f0-337ed85fa2b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.447288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98689de-cc1e-42d3-98f0-337ed85fa2b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:05.447522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 249/507] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:05.447588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98689de-cc1e-42d3-98f0-337ed85fa2b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:05.447651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cb46f-57a6-4675-a11e-3a8f47d9a042 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.447714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98689de-cc1e-42d3-98f0-337ed85fa2b1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:05.455694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 259/508] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:05.456472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98689de-cc1e-42d3-98f0-337ed85fa2b1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.467253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:05.520803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:05.567520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98689de-cc1e-42d3-98f0-337ed85fa2b1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.570533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cb46f-57a6-4675-a11e-3a8f47d9a042 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.603797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed060bdb-319b-40da-a8e5-b5657e82ae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.603996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3ebd9-ddc3-48a2-9935-dda1109ed606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.604431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed060bdb-319b-40da-a8e5-b5657e82ae0b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.604558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3ebd9-ddc3-48a2-9935-dda1109ed606 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.604737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3ebd9-ddc3-48a2-9935-dda1109ed606 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.604827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed060bdb-319b-40da-a8e5-b5657e82ae0b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.604967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3ebd9-ddc3-48a2-9935-dda1109ed606 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.605083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed060bdb-319b-40da-a8e5-b5657e82ae0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.614276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3ebd9-ddc3-48a2-9935-dda1109ed606 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:05.615656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed060bdb-319b-40da-a8e5-b5657e82ae0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:05.616141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3ebd9-ddc3-48a2-9935-dda1109ed606 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:05.617156 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed060bdb-319b-40da-a8e5-b5657e82ae0b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-78a3ebd9-ddc3-48a2-9935-dda1109ed606 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:05.627656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:05.628707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 260/509] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:05.629864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3ebd9-ddc3-48a2-9935-dda1109ed606 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ed060bdb-319b-40da-a8e5-b5657e82ae0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:05.631370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:05.632227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:05.633072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:05.633072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:05.633072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:05.634626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 250/510] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:05.635420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed060bdb-319b-40da-a8e5-b5657e82ae0b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.697100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:05.734949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3ebd9-ddc3-48a2-9935-dda1109ed606 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.749157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed060bdb-319b-40da-a8e5-b5657e82ae0b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.769085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:05.770719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3221913-b1c6-4369-b68b-6efe467f92ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.771697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3221913-b1c6-4369-b68b-6efe467f92ea None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.771917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3221913-b1c6-4369-b68b-6efe467f92ea None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.772211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3221913-b1c6-4369-b68b-6efe467f92ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.782656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3221913-b1c6-4369-b68b-6efe467f92ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:05.784118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3221913-b1c6-4369-b68b-6efe467f92ea None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:05.787510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0cc84-6ee7-4439-a222-0df8aaca5dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.788124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0cc84-6ee7-4439-a222-0df8aaca5dfe None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.788404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0cc84-6ee7-4439-a222-0df8aaca5dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.788675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0cc84-6ee7-4439-a222-0df8aaca5dfe None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.789439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0cc84-6ee7-4439-a222-0df8aaca5dfe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:05.789743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0cc84-6ee7-4439-a222-0df8aaca5dfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:05.791181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0cc84-6ee7-4439-a222-0df8aaca5dfe None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a3221913-b1c6-4369-b68b-6efe467f92ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:05.798312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:05.799342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:05.800177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:05.800177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:05.800177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:05.800177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 261/511] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:05.800177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3221913-b1c6-4369-b68b-6efe467f92ea None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.809053 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 251/512] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:05.809868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0cc84-6ee7-4439-a222-0df8aaca5dfe None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.906678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0cc84-6ee7-4439-a222-0df8aaca5dfe None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.913741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3221913-b1c6-4369-b68b-6efe467f92ea None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:05.930737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:05.941588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d40987-9bf1-455b-95c0-674c35d6cec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.942201 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40987-9bf1-455b-95c0-674c35d6cec3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.942496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40987-9bf1-455b-95c0-674c35d6cec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.942774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d40987-9bf1-455b-95c0-674c35d6cec3 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.943508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d40987-9bf1-455b-95c0-674c35d6cec3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:05.943816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d40987-9bf1-455b-95c0-674c35d6cec3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:05.945296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d40987-9bf1-455b-95c0-674c35d6cec3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:05.948531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34510-5acd-4e2d-8cc4-53372dd4c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:05.949195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34510-5acd-4e2d-8cc4-53372dd4c454 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:05.949474 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34510-5acd-4e2d-8cc4-53372dd4c454 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:05.949743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34510-5acd-4e2d-8cc4-53372dd4c454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:05.960274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e34510-5acd-4e2d-8cc4-53372dd4c454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:05.961764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e34510-5acd-4e2d-8cc4-53372dd4c454 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:05.962249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 252/513] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:05.962905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d40987-9bf1-455b-95c0-674c35d6cec3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b4e34510-5acd-4e2d-8cc4-53372dd4c454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:05.979335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:05.980437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:05.981299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:05.981299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:05.981299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:05.981299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 262/514] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:05.981817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34510-5acd-4e2d-8cc4-53372dd4c454 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:05.992951 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:06.062816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d40987-9bf1-455b-95c0-674c35d6cec3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:06.078297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e34510-5acd-4e2d-8cc4-53372dd4c454 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:06.095110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7b260-913d-438e-acac-ba17d550a7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:06.095765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7b260-913d-438e-acac-ba17d550a7db None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:06.096040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7b260-913d-438e-acac-ba17d550a7db None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:06.096322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7b260-913d-438e-acac-ba17d550a7db None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:06.096963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7b260-913d-438e-acac-ba17d550a7db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:06.097300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7b260-913d-438e-acac-ba17d550a7db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:06.098661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7b260-913d-438e-acac-ba17d550a7db None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:06.110577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 253/515] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:06.111383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7b260-913d-438e-acac-ba17d550a7db None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:06.111486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc4f61-4c1a-4536-8e2b-600ad435a2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:06.112132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc4f61-4c1a-4536-8e2b-600ad435a2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:06.112353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc4f61-4c1a-4536-8e2b-600ad435a2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:06.112612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc4f61-4c1a-4536-8e2b-600ad435a2f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:06.113280 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc4f61-4c1a-4536-8e2b-600ad435a2f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:06.113574 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc4f61-4c1a-4536-8e2b-600ad435a2f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:06.114977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc4f61-4c1a-4536-8e2b-600ad435a2f7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:06.127138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 263/516] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:06.128060 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc4f61-4c1a-4536-8e2b-600ad435a2f7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:06.169441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:06.208865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:06.218357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7b260-913d-438e-acac-ba17d550a7db None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:06.238535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc4f61-4c1a-4536-8e2b-600ad435a2f7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:06.251659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b607834-619d-4699-b978-e1fbe27eedbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:06.252364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b607834-619d-4699-b978-e1fbe27eedbc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:06.252708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b607834-619d-4699-b978-e1fbe27eedbc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:06.253073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b607834-619d-4699-b978-e1fbe27eedbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:06.272649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdfdce-3494-44a2-8388-e07064077b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:06.273350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdfdce-3494-44a2-8388-e07064077b02 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:06.273633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdfdce-3494-44a2-8388-e07064077b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:06.273906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdfdce-3494-44a2-8388-e07064077b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:06.318649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b607834-619d-4699-b978-e1fbe27eedbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:06.320034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b607834-619d-4699-b978-e1fbe27eedbc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:06.339776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdfdce-3494-44a2-8388-e07064077b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:06.341275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdfdce-3494-44a2-8388-e07064077b02 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:06.369447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:06.408769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:06.418359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 254/517] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:06.419316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b607834-619d-4699-b978-e1fbe27eedbc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:06.443889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 264/518] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:06.443889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdfdce-3494-44a2-8388-e07064077b02 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:06.517381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b607834-619d-4699-b978-e1fbe27eedbc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:06.536455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdfdce-3494-44a2-8388-e07064077b02 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:06.551260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aac2dc-2b4a-40ee-9ab3-1e57ef0c22bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:06.551942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aac2dc-2b4a-40ee-9ab3-1e57ef0c22bb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:06.552234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aac2dc-2b4a-40ee-9ab3-1e57ef0c22bb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:06.552511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aac2dc-2b4a-40ee-9ab3-1e57ef0c22bb None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:06.553196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aac2dc-2b4a-40ee-9ab3-1e57ef0c22bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:06.553499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aac2dc-2b4a-40ee-9ab3-1e57ef0c22bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:06.554882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aac2dc-2b4a-40ee-9ab3-1e57ef0c22bb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:06.564742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:06.566108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 255/519] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:06.567123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aac2dc-2b4a-40ee-9ab3-1e57ef0c22bb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:06.573828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c386c-f2fa-4b04-87b2-05a17a07be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:06.574394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c386c-f2fa-4b04-87b2-05a17a07be8d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:06.574665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c386c-f2fa-4b04-87b2-05a17a07be8d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:06.574956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c386c-f2fa-4b04-87b2-05a17a07be8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:06.581680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c386c-f2fa-4b04-87b2-05a17a07be8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:06.583148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c386c-f2fa-4b04-87b2-05a17a07be8d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-755c386c-f2fa-4b04-87b2-05a17a07be8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:06.594555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:06.595485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:06.596355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:06.596355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:06.596355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:06.596355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:06.596355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:06.596355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:06.596355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:06.596355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:06.596355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 265/520] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:06.600966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c386c-f2fa-4b04-87b2-05a17a07be8d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:06.620806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:06.667706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aac2dc-2b4a-40ee-9ab3-1e57ef0c22bb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:06.699480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c386c-f2fa-4b04-87b2-05a17a07be8d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:06.701819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eea3ce-c1c0-47b7-98a3-08067b49c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:06.702429 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eea3ce-c1c0-47b7-98a3-08067b49c2fb None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:06.702678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eea3ce-c1c0-47b7-98a3-08067b49c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:06.702984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eea3ce-c1c0-47b7-98a3-08067b49c2fb None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:06.703620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eea3ce-c1c0-47b7-98a3-08067b49c2fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:06.705108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eea3ce-c1c0-47b7-98a3-08067b49c2fb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:06.726429 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 256/521] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:57:06 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:06.727237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eea3ce-c1c0-47b7-98a3-08067b49c2fb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:06.747831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111d4f-31ab-495c-acf8-4c0bd5034b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:06.748479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111d4f-31ab-495c-acf8-4c0bd5034b1a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:06.748731 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111d4f-31ab-495c-acf8-4c0bd5034b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:06.749073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111d4f-31ab-495c-acf8-4c0bd5034b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:06.760725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c111d4f-31ab-495c-acf8-4c0bd5034b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:06.762270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c111d4f-31ab-495c-acf8-4c0bd5034b1a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3c111d4f-31ab-495c-acf8-4c0bd5034b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:06.778651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:06.779631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:06.780483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:06.780483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:06.780483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:06.780483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 266/522] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:06.780704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111d4f-31ab-495c-acf8-4c0bd5034b1a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:06.828225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:06.849888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eea3ce-c1c0-47b7-98a3-08067b49c2fb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:06.860339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:06.889842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285371b5-c53f-47e5-afba-35a97b063f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:06.890762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285371b5-c53f-47e5-afba-35a97b063f1e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:06.891200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285371b5-c53f-47e5-afba-35a97b063f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:06.891481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285371b5-c53f-47e5-afba-35a97b063f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:06.899404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111d4f-31ab-495c-acf8-4c0bd5034b1a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:06.905853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285371b5-c53f-47e5-afba-35a97b063f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:06.907534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285371b5-c53f-47e5-afba-35a97b063f1e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-285371b5-c53f-47e5-afba-35a97b063f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:06.923912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:06.925017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:06.926052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:06.926052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:06.926052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:06.926052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 257/523] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:06.926052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285371b5-c53f-47e5-afba-35a97b063f1e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:06.940884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d753e-386c-417c-a2ef-45fc8387a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:06.941834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d753e-386c-417c-a2ef-45fc8387a04c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:06.942126 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d753e-386c-417c-a2ef-45fc8387a04c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:06.942400 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d753e-386c-417c-a2ef-45fc8387a04c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:06.950599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d753e-386c-417c-a2ef-45fc8387a04c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:06.952321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d753e-386c-417c-a2ef-45fc8387a04c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-915d753e-386c-417c-a2ef-45fc8387a04c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:06.964943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:06.965872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:06.966747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:06.966747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:06.966747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:06.966747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:06.966747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:06.966747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:06.966747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:06.966747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:06.966747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:57:06.966747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:06.970827 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 267/524] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:06.971695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d753e-386c-417c-a2ef-45fc8387a04c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:07.036648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285371b5-c53f-47e5-afba-35a97b063f1e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:07.072533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd722a72-90f6-4f59-95ab-c137d58fc7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:07.073178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd722a72-90f6-4f59-95ab-c137d58fc7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:07.073639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd722a72-90f6-4f59-95ab-c137d58fc7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:07.073926 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd722a72-90f6-4f59-95ab-c137d58fc7a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:07.074960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd722a72-90f6-4f59-95ab-c137d58fc7a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:07.075435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd722a72-90f6-4f59-95ab-c137d58fc7a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:07.076885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd722a72-90f6-4f59-95ab-c137d58fc7a9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:07.083107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d753e-386c-417c-a2ef-45fc8387a04c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:07.084807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:07.095175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 258/525] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:07.096101 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd722a72-90f6-4f59-95ab-c137d58fc7a9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:07.122869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:07.123828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357038-78f2-4abf-b867-c94d0dc40bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:07.124422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357038-78f2-4abf-b867-c94d0dc40bad None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:07.124687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357038-78f2-4abf-b867-c94d0dc40bad None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:07.125119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357038-78f2-4abf-b867-c94d0dc40bad None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:07.125596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357038-78f2-4abf-b867-c94d0dc40bad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:07.125902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357038-78f2-4abf-b867-c94d0dc40bad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:07.127357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357038-78f2-4abf-b867-c94d0dc40bad None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:07.144279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 268/526] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:07.144279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357038-78f2-4abf-b867-c94d0dc40bad None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:07.217693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd722a72-90f6-4f59-95ab-c137d58fc7a9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:07.243547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357038-78f2-4abf-b867-c94d0dc40bad None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:07.255785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf283bb-6ebc-4d59-a506-c5e1e8ae8110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:07.256401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf283bb-6ebc-4d59-a506-c5e1e8ae8110 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:07.256682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf283bb-6ebc-4d59-a506-c5e1e8ae8110 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:07.256953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf283bb-6ebc-4d59-a506-c5e1e8ae8110 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:07.257703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf283bb-6ebc-4d59-a506-c5e1e8ae8110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:07.258007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf283bb-6ebc-4d59-a506-c5e1e8ae8110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:07.259397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf283bb-6ebc-4d59-a506-c5e1e8ae8110 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:07.273186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 259/527] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:07.273186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf283bb-6ebc-4d59-a506-c5e1e8ae8110 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:07.284915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511c068-c8da-400a-9fa6-4d7866857487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:07.285691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511c068-c8da-400a-9fa6-4d7866857487 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:07.285911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511c068-c8da-400a-9fa6-4d7866857487 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:07.286187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511c068-c8da-400a-9fa6-4d7866857487 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:07.286956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511c068-c8da-400a-9fa6-4d7866857487 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:07.287251 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511c068-c8da-400a-9fa6-4d7866857487 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:07.288695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511c068-c8da-400a-9fa6-4d7866857487 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:07.325810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 269/528] 10.222.0.76 () {56 vars in 1139 bytes} [Mon Sep 19 16:57:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:07.331139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511c068-c8da-400a-9fa6-4d7866857487 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:07.353328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:07.358612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:07.381916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf283bb-6ebc-4d59-a506-c5e1e8ae8110 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:07.419203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81aeaa-92c4-4014-8f86-ffba7ac5ffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:07.419812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81aeaa-92c4-4014-8f86-ffba7ac5ffe0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:07.420096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81aeaa-92c4-4014-8f86-ffba7ac5ffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:07.420369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81aeaa-92c4-4014-8f86-ffba7ac5ffe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:07.421123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81aeaa-92c4-4014-8f86-ffba7ac5ffe0 None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=ea18c782ddf2469fa3d10a135fc34c37) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:07.421433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81aeaa-92c4-4014-8f86-ffba7ac5ffe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:07.422876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81aeaa-92c4-4014-8f86-ffba7ac5ffe0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:07.437066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 260/529] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:07 2022] GET /identity/v3/role_assignments?user.id=ea18c782ddf2469fa3d10a135fc34c37&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:07.437066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81aeaa-92c4-4014-8f86-ffba7ac5ffe0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:07.445986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511c068-c8da-400a-9fa6-4d7866857487 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:07.494671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fcb88-afc0-4669-a3a6-40f73bd903fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:07.496160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fcb88-afc0-4669-a3a6-40f73bd903fe None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:07.496516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fcb88-afc0-4669-a3a6-40f73bd903fe None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:07.496858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fcb88-afc0-4669-a3a6-40f73bd903fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:07.508564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fcb88-afc0-4669-a3a6-40f73bd903fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:07.510518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fcb88-afc0-4669-a3a6-40f73bd903fe None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ba0fcb88-afc0-4669-a3a6-40f73bd903fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:07.527807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:07.528897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:07.529958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:07.529958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:07.529958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:07.529958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:07.529958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:07.529958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:07.529958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:07.529958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:07.530543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 270/530] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:07.531597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fcb88-afc0-4669-a3a6-40f73bd903fe None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:07.551295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81aeaa-92c4-4014-8f86-ffba7ac5ffe0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:07.589454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12632802-1315-42bb-b28f-5b99e6fed5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:07.590279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12632802-1315-42bb-b28f-5b99e6fed5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:07.590660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12632802-1315-42bb-b28f-5b99e6fed5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:07.591090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12632802-1315-42bb-b28f-5b99e6fed5d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:07.598640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12632802-1315-42bb-b28f-5b99e6fed5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:07.600362 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12632802-1315-42bb-b28f-5b99e6fed5d8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-12632802-1315-42bb-b28f-5b99e6fed5d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:07.616879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:07.618003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:07.619049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:07.619049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:07.619049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:07.619049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:07.619049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:07.619049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:07.619049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:07.619049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:07.621175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 261/531] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:07.621175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12632802-1315-42bb-b28f-5b99e6fed5d8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:07.625717 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:07.653782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:07.678952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fcb88-afc0-4669-a3a6-40f73bd903fe None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:07.731895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87eeb2-b619-48cd-a80f-e1f479ef9c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:07.732775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87eeb2-b619-48cd-a80f-e1f479ef9c06 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:07.733080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87eeb2-b619-48cd-a80f-e1f479ef9c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:07.733357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87eeb2-b619-48cd-a80f-e1f479ef9c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:07.736601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12632802-1315-42bb-b28f-5b99e6fed5d8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:07.772409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281768c-1161-4480-8972-a691c0870e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:07.773287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281768c-1161-4480-8972-a691c0870e68 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:07.773709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281768c-1161-4480-8972-a691c0870e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:07.774170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281768c-1161-4480-8972-a691c0870e68 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:07.775052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281768c-1161-4480-8972-a691c0870e68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:07.775522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281768c-1161-4480-8972-a691c0870e68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:07.777178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281768c-1161-4480-8972-a691c0870e68 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:07.790453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 262/532] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:07.791567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281768c-1161-4480-8972-a691c0870e68 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:07.828651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87eeb2-b619-48cd-a80f-e1f479ef9c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:07.830840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87eeb2-b619-48cd-a80f-e1f479ef9c06 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:07.861738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:07.915562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281768c-1161-4480-8972-a691c0870e68 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:07.925215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:07.955145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 271/533] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:07.956301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87eeb2-b619-48cd-a80f-e1f479ef9c06 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:07.963326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b25849-6ee1-456e-9144-2ccea148b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:07.963950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b25849-6ee1-456e-9144-2ccea148b735 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:07.964231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b25849-6ee1-456e-9144-2ccea148b735 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:07.964556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b25849-6ee1-456e-9144-2ccea148b735 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:07.965288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b25849-6ee1-456e-9144-2ccea148b735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:07.966170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b25849-6ee1-456e-9144-2ccea148b735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:07.967650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b25849-6ee1-456e-9144-2ccea148b735 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:07.985125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 263/534] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:07.986298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b25849-6ee1-456e-9144-2ccea148b735 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:08.078677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87eeb2-b619-48cd-a80f-e1f479ef9c06 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:08.115005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319be48-a70b-4522-87f6-930f1dcb735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:08.116331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319be48-a70b-4522-87f6-930f1dcb735e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:08.116780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319be48-a70b-4522-87f6-930f1dcb735e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:08.117244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319be48-a70b-4522-87f6-930f1dcb735e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:08.118184 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319be48-a70b-4522-87f6-930f1dcb735e None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=2c746178628e4df5961982268e642ff7) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:08.118689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319be48-a70b-4522-87f6-930f1dcb735e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:08.120307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319be48-a70b-4522-87f6-930f1dcb735e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:08.121559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b25849-6ee1-456e-9144-2ccea148b735 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:08.127317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 272/535] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:07 2022] GET /identity/v3/role_assignments?user.id=2c746178628e4df5961982268e642ff7&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:08.128379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319be48-a70b-4522-87f6-930f1dcb735e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:08.190565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:08.201664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:08.233007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210a69c-94a2-4420-8ca1-6bf98ed6db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:08.234218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210a69c-94a2-4420-8ca1-6bf98ed6db95 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:08.234218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210a69c-94a2-4420-8ca1-6bf98ed6db95 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:08.234218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210a69c-94a2-4420-8ca1-6bf98ed6db95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:08.262027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210a69c-94a2-4420-8ca1-6bf98ed6db95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:08.263526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210a69c-94a2-4420-8ca1-6bf98ed6db95 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:08.268484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319be48-a70b-4522-87f6-930f1dcb735e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d210a69c-94a2-4420-8ca1-6bf98ed6db95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:08.294631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:08.295601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:08.296430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:08.296430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:08.296430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:08.301533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 264/536] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:08.306795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210a69c-94a2-4420-8ca1-6bf98ed6db95 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:08.312850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be132570-8ba8-489f-aec9-77d8bc3ce02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:08.314775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be132570-8ba8-489f-aec9-77d8bc3ce02c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:08.315258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be132570-8ba8-489f-aec9-77d8bc3ce02c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:08.315728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be132570-8ba8-489f-aec9-77d8bc3ce02c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:08.316669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be132570-8ba8-489f-aec9-77d8bc3ce02c None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=7338fa9ff18c42f8bc26710ab8376b3f) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:08.317236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be132570-8ba8-489f-aec9-77d8bc3ce02c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:08.318913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be132570-8ba8-489f-aec9-77d8bc3ce02c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:08.333913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 273/537] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:08 2022] GET /identity/v3/role_assignments?user.id=7338fa9ff18c42f8bc26710ab8376b3f&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:08.486902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210a69c-94a2-4420-8ca1-6bf98ed6db95 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:08.540540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2596a4-a6fa-4f93-a719-38332153436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:08.542260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2596a4-a6fa-4f93-a719-38332153436f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:08.542260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2596a4-a6fa-4f93-a719-38332153436f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:08.542260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2596a4-a6fa-4f93-a719-38332153436f None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:08.542494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2596a4-a6fa-4f93-a719-38332153436f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:08.542686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2596a4-a6fa-4f93-a719-38332153436f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:08.544052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2596a4-a6fa-4f93-a719-38332153436f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:08.558966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 265/538] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:08.564129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be132570-8ba8-489f-aec9-77d8bc3ce02c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:08.671407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be132570-8ba8-489f-aec9-77d8bc3ce02c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:08.680862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:08.713396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a068-4d0b-47b9-b77b-a03c27b37aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:08.714046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a068-4d0b-47b9-b77b-a03c27b37aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:08.714326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a068-4d0b-47b9-b77b-a03c27b37aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:08.714599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2a068-4d0b-47b9-b77b-a03c27b37aa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:08.721632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a068-4d0b-47b9-b77b-a03c27b37aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:08.723190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2a068-4d0b-47b9-b77b-a03c27b37aa1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-dce2a068-4d0b-47b9-b77b-a03c27b37aa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:08.739225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:08.740103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:08.741383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:08.741383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:08.741383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:08.741383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:08.741383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:08.741383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:08.741383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:08.741383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:08.741383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 274/539] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:08.746233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2596a4-a6fa-4f93-a719-38332153436f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:08.788517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:08.871448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2596a4-a6fa-4f93-a719-38332153436f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:08.919366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ec73a-5e28-4148-aa2a-e2f34bd3cb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:08.919985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ec73a-5e28-4148-aa2a-e2f34bd3cb55 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:08.920266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ec73a-5e28-4148-aa2a-e2f34bd3cb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:08.920539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ec73a-5e28-4148-aa2a-e2f34bd3cb55 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:08.921258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ec73a-5e28-4148-aa2a-e2f34bd3cb55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:08.921637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ec73a-5e28-4148-aa2a-e2f34bd3cb55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:08.923069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ec73a-5e28-4148-aa2a-e2f34bd3cb55 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:08.938880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 266/540] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:08.944493 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a068-4d0b-47b9-b77b-a03c27b37aa1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:09.012963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ee550-c6e8-4785-8c52-881670b506d6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:09.013589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ee550-c6e8-4785-8c52-881670b506d6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:09.014093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ee550-c6e8-4785-8c52-881670b506d6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:09.015912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 267/541] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:09.021742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524999ab-f893-4144-a1f0-abb2e677b0fa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:09.022376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524999ab-f893-4144-a1f0-abb2e677b0fa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:09.022855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524999ab-f893-4144-a1f0-abb2e677b0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:09.058096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-524999ab-f893-4144-a1f0-abb2e677b0fa None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:09.059340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-524999ab-f893-4144-a1f0-abb2e677b0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:09.097498 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2a068-4d0b-47b9-b77b-a03c27b37aa1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:09.136059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26006438-e11c-4a59-880a-41a775943b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:09.136672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26006438-e11c-4a59-880a-41a775943b42 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:09.136955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26006438-e11c-4a59-880a-41a775943b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:09.137273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26006438-e11c-4a59-880a-41a775943b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:09.138022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26006438-e11c-4a59-880a-41a775943b42 None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=da4a83dd0cb64e219bc16f8cf0b0af57) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:09.138333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26006438-e11c-4a59-880a-41a775943b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:09.139815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26006438-e11c-4a59-880a-41a775943b42 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:09.151559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 275/542] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:08 2022] GET /identity/v3/role_assignments?user.id=da4a83dd0cb64e219bc16f8cf0b0af57&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:09.203518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 268/543] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:09.528655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26006438-e11c-4a59-880a-41a775943b42 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:09.575866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:09.669537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26006438-e11c-4a59-880a-41a775943b42 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:09.716039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9df53-dd7c-4681-beef-61b539bdf4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:09.717052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9df53-dd7c-4681-beef-61b539bdf4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:09.717527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9df53-dd7c-4681-beef-61b539bdf4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:09.717987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9df53-dd7c-4681-beef-61b539bdf4c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:09.733906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9df53-dd7c-4681-beef-61b539bdf4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-46a9df53-dd7c-4681-beef-61b539bdf4c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:09.740066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:09.740928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:09.741777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:09.748937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 276/544] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:09.750565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524999ab-f893-4144-a1f0-abb2e677b0fa None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:09.793149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:09.819164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cadaa2-f58d-4f34-8f59-1c2e0bf089a9 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:09.819491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cadaa2-f58d-4f34-8f59-1c2e0bf089a9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:09.819707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cadaa2-f58d-4f34-8f59-1c2e0bf089a9 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:09.821278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 277/545] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:09.826493 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8dc2-65dd-4689-a804-d260c11d9d5d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:09.827079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8dc2-65dd-4689-a804-d260c11d9d5d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:09.827550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba8dc2-65dd-4689-a804-d260c11d9d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:09.862168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-24ba8dc2-65dd-4689-a804-d260c11d9d5d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:09.863809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-24ba8dc2-65dd-4689-a804-d260c11d9d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:09.875915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524999ab-f893-4144-a1f0-abb2e677b0fa None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:09.935420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12640da5-ff31-4eae-a068-068fdc6a59e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:09.936450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12640da5-ff31-4eae-a068-068fdc6a59e2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:09.936931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12640da5-ff31-4eae-a068-068fdc6a59e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:09.937422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12640da5-ff31-4eae-a068-068fdc6a59e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:09.938297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12640da5-ff31-4eae-a068-068fdc6a59e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:09.938824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12640da5-ff31-4eae-a068-068fdc6a59e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:09.940403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12640da5-ff31-4eae-a068-068fdc6a59e2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:09.957004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 269/546] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:09.962813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12640da5-ff31-4eae-a068-068fdc6a59e2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:09.967439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 278/547] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:57:10.091494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:10.108413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12640da5-ff31-4eae-a068-068fdc6a59e2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:10.152125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796f4dc-e9b5-40d0-9654-4fe60a00eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:10.152816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796f4dc-e9b5-40d0-9654-4fe60a00eeed None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:10.153127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796f4dc-e9b5-40d0-9654-4fe60a00eeed None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:10.153406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796f4dc-e9b5-40d0-9654-4fe60a00eeed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:10.170190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796f4dc-e9b5-40d0-9654-4fe60a00eeed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:10.171672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796f4dc-e9b5-40d0-9654-4fe60a00eeed None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b796f4dc-e9b5-40d0-9654-4fe60a00eeed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:10.192911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:10.193829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:10.195034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:10.195034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:10.195034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:10.195034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 270/548] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:10.202132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba8dc2-65dd-4689-a804-d260c11d9d5d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:10.243764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:10.345479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796f4dc-e9b5-40d0-9654-4fe60a00eeed None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:10.347847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba8dc2-65dd-4689-a804-d260c11d9d5d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:10.386910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7786b52-9a38-4788-91b7-09d3fcfcef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:10.387888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7786b52-9a38-4788-91b7-09d3fcfcef60 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:10.388357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7786b52-9a38-4788-91b7-09d3fcfcef60 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:10.388857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7786b52-9a38-4788-91b7-09d3fcfcef60 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:10.389768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7786b52-9a38-4788-91b7-09d3fcfcef60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:10.390258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7786b52-9a38-4788-91b7-09d3fcfcef60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:10.391839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7786b52-9a38-4788-91b7-09d3fcfcef60 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:10.404738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 279/549] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:10.409858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7786b52-9a38-4788-91b7-09d3fcfcef60 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:10.535159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796f4dc-e9b5-40d0-9654-4fe60a00eeed None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:10.541391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:10.565387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7786b52-9a38-4788-91b7-09d3fcfcef60 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:10.574332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bcac5-5a4d-49e1-9bd9-7556c6441c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:10.575503 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bcac5-5a4d-49e1-9bd9-7556c6441c6c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:10.575979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bcac5-5a4d-49e1-9bd9-7556c6441c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:10.576497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bcac5-5a4d-49e1-9bd9-7556c6441c6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:10.585220 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:10.589783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bcac5-5a4d-49e1-9bd9-7556c6441c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e33bcac5-5a4d-49e1-9bd9-7556c6441c6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:10.597205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:10.598953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:10.599884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 271/550] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:10.603440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bcac5-5a4d-49e1-9bd9-7556c6441c6c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:10.657762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c303-e3d6-46b1-be37-03c6d16885c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:10.658525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c303-e3d6-46b1-be37-03c6d16885c2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:10.658733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c303-e3d6-46b1-be37-03c6d16885c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:10.658956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c303-e3d6-46b1-be37-03c6d16885c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:10.673957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060c303-e3d6-46b1-be37-03c6d16885c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:10.675492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060c303-e3d6-46b1-be37-03c6d16885c2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e060c303-e3d6-46b1-be37-03c6d16885c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:10.698633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:10.699615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:10.701205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:10.701205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:10.701205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:10.701205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:10.701205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:10.701205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:10.701205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:10.701205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:10.701205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:10.701205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:10.709379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 280/551] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:10.710300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c303-e3d6-46b1-be37-03c6d16885c2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:10.717199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bcac5-5a4d-49e1-9bd9-7556c6441c6c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:10.778247 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdaa96-1682-46f0-aa7f-8e8028234117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:10.779257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdaa96-1682-46f0-aa7f-8e8028234117 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:10.779748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdaa96-1682-46f0-aa7f-8e8028234117 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:10.780251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdaa96-1682-46f0-aa7f-8e8028234117 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:10.781147 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdaa96-1682-46f0-aa7f-8e8028234117 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:10.781689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdaa96-1682-46f0-aa7f-8e8028234117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:10.783412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdaa96-1682-46f0-aa7f-8e8028234117 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:10.792647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 272/552] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:10.802803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdaa96-1682-46f0-aa7f-8e8028234117 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:10.916643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060c303-e3d6-46b1-be37-03c6d16885c2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:10.934613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:10.991665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcf341-57c8-4997-8ec2-6d2a0e5512d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:10.992750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcf341-57c8-4997-8ec2-6d2a0e5512d9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:10.993370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcf341-57c8-4997-8ec2-6d2a0e5512d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:10.994610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcf341-57c8-4997-8ec2-6d2a0e5512d9 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:10.996209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcf341-57c8-4997-8ec2-6d2a0e5512d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:10.996892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcf341-57c8-4997-8ec2-6d2a0e5512d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:10.999480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcf341-57c8-4997-8ec2-6d2a0e5512d9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:11.012556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdaa96-1682-46f0-aa7f-8e8028234117 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:11.021707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:11.030020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 281/553] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Sep 19 16:57:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:11.031610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c77055-27d9-4813-8048-dbd272dbb964 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.032096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c77055-27d9-4813-8048-dbd272dbb964 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.032541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c77055-27d9-4813-8048-dbd272dbb964 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.034286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 282/554] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:11.035196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c77055-27d9-4813-8048-dbd272dbb964 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:11.057160 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee76122-8e93-4903-919a-b4762ba75480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:11.057799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee76122-8e93-4903-919a-b4762ba75480 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.058078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee76122-8e93-4903-919a-b4762ba75480 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.058593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee76122-8e93-4903-919a-b4762ba75480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.069506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee76122-8e93-4903-919a-b4762ba75480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:11.070956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee76122-8e93-4903-919a-b4762ba75480 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6ee76122-8e93-4903-919a-b4762ba75480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:11.088035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:11.088960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:11.089861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:11.089861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:11.089861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:11.090775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 273/555] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:11.091500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468d93d-fea5-46f3-89c4-5ed77966ab3b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.091785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468d93d-fea5-46f3-89c4-5ed77966ab3b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.092061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468d93d-fea5-46f3-89c4-5ed77966ab3b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.093450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 274/556] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:11.098419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac9006-a5fc-41f2-b1c7-92d688b05380 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.098777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac9006-a5fc-41f2-b1c7-92d688b05380 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.099016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac9006-a5fc-41f2-b1c7-92d688b05380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.117313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-44ac9006-a5fc-41f2-b1c7-92d688b05380 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:11.118590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-44ac9006-a5fc-41f2-b1c7-92d688b05380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:11.151024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c77055-27d9-4813-8048-dbd272dbb964 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:11.187706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba353-9ce2-4c6a-92f4-7b570c36d7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:11.188234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba353-9ce2-4c6a-92f4-7b570c36d7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.188518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba353-9ce2-4c6a-92f4-7b570c36d7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.188786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ba353-9ce2-4c6a-92f4-7b570c36d7f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.200119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 275/557] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:11.213904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93649af-3d4e-4211-a136-61ddf8dcf2de None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.214431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93649af-3d4e-4211-a136-61ddf8dcf2de None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.215111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93649af-3d4e-4211-a136-61ddf8dcf2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.239931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d93649af-3d4e-4211-a136-61ddf8dcf2de None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:11.242129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d93649af-3d4e-4211-a136-61ddf8dcf2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:11.260496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:11.263027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ba353-9ce2-4c6a-92f4-7b570c36d7f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:11.265138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ba353-9ce2-4c6a-92f4-7b570c36d7f4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:11.301234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:11.338852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 276/558] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:11.340130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93649af-3d4e-4211-a136-61ddf8dcf2de None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:11.385944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 283/559] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:11.391880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba353-9ce2-4c6a-92f4-7b570c36d7f4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:11.510404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:11.513979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ba353-9ce2-4c6a-92f4-7b570c36d7f4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:11.516204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93649af-3d4e-4211-a136-61ddf8dcf2de None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:11.551788 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b4691-90ca-4122-9f82-8435f7b83eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:11.553076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4691-90ca-4122-9f82-8435f7b83eac None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.553459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4691-90ca-4122-9f82-8435f7b83eac None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.553894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b4691-90ca-4122-9f82-8435f7b83eac None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.554644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b4691-90ca-4122-9f82-8435f7b83eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:11.555047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b4691-90ca-4122-9f82-8435f7b83eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:11.556844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b4691-90ca-4122-9f82-8435f7b83eac None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:11.558158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b665a-08a8-4082-8eaa-71aeb518f04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:11.559049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b665a-08a8-4082-8eaa-71aeb518f04d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.559328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b665a-08a8-4082-8eaa-71aeb518f04d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.560137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b665a-08a8-4082-8eaa-71aeb518f04d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.569896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 277/560] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:11.570823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b4691-90ca-4122-9f82-8435f7b83eac None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:11.577726 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b665a-08a8-4082-8eaa-71aeb518f04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:11.579202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b665a-08a8-4082-8eaa-71aeb518f04d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ca5b665a-08a8-4082-8eaa-71aeb518f04d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:11.598062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:11.599206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:11.600070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:11.600070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:11.600070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:11.600070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 284/561] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:11.600973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b665a-08a8-4082-8eaa-71aeb518f04d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:11.620941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:11.701873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b4691-90ca-4122-9f82-8435f7b83eac None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:11.712146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b665a-08a8-4082-8eaa-71aeb518f04d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:11.737811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de27a3c-fc5e-4e6c-8bd3-8a2a9cb390b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:11.738444 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de27a3c-fc5e-4e6c-8bd3-8a2a9cb390b5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.738731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de27a3c-fc5e-4e6c-8bd3-8a2a9cb390b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.739011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de27a3c-fc5e-4e6c-8bd3-8a2a9cb390b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.746034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3b19f-0a0f-45e1-adff-02d7c8cb2238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:11.746859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3b19f-0a0f-45e1-adff-02d7c8cb2238 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.747320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3b19f-0a0f-45e1-adff-02d7c8cb2238 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.747594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3b19f-0a0f-45e1-adff-02d7c8cb2238 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.750030 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de27a3c-fc5e-4e6c-8bd3-8a2a9cb390b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:11.755345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3b19f-0a0f-45e1-adff-02d7c8cb2238 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8de27a3c-fc5e-4e6c-8bd3-8a2a9cb390b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:11.756542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:11.757475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:11.758296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:11.759660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3b19f-0a0f-45e1-adff-02d7c8cb2238 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:11.761432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 278/562] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:11.762849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de27a3c-fc5e-4e6c-8bd3-8a2a9cb390b5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-07b3b19f-0a0f-45e1-adff-02d7c8cb2238 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:11.769059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:11.770456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:11.771460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 285/563] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Sep 19 16:57:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:11.772058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3b19f-0a0f-45e1-adff-02d7c8cb2238 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:11.788972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:11.856637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:11.863932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de27a3c-fc5e-4e6c-8bd3-8a2a9cb390b5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:11.872629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3b19f-0a0f-45e1-adff-02d7c8cb2238 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:11.897106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e43398-b2c9-40f0-9659-9e0d7c5d462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:11.897723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e43398-b2c9-40f0-9659-9e0d7c5d462b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.898002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e43398-b2c9-40f0-9659-9e0d7c5d462b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.898274 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e43398-b2c9-40f0-9659-9e0d7c5d462b None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.898922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e43398-b2c9-40f0-9659-9e0d7c5d462b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:11.899227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e43398-b2c9-40f0-9659-9e0d7c5d462b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:11.900601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e43398-b2c9-40f0-9659-9e0d7c5d462b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:11.905149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a7cd4-2b35-488e-a9c0-672cc26b1f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:11.905776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a7cd4-2b35-488e-a9c0-672cc26b1f5f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.906058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a7cd4-2b35-488e-a9c0-672cc26b1f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.906332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a7cd4-2b35-488e-a9c0-672cc26b1f5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.912514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 279/564] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:11.913366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e43398-b2c9-40f0-9659-9e0d7c5d462b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:11.921390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a7cd4-2b35-488e-a9c0-672cc26b1f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-039a7cd4-2b35-488e-a9c0-672cc26b1f5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:11.926647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:11.927824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:11.928670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:11.929537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 286/565] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:11.930675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f6c45-6de3-4cd5-b74a-d1e5dadfb650 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:11.931117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f6c45-6de3-4cd5-b74a-d1e5dadfb650 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:11.931398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f6c45-6de3-4cd5-b74a-d1e5dadfb650 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:11.932954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 287/566] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:11.933671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f6c45-6de3-4cd5-b74a-d1e5dadfb650 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.007886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:12.024783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e43398-b2c9-40f0-9659-9e0d7c5d462b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.042417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f6c45-6de3-4cd5-b74a-d1e5dadfb650 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.058703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9045bd-fff8-4342-90be-392e4f35e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.059314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9045bd-fff8-4342-90be-392e4f35e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.059636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9045bd-fff8-4342-90be-392e4f35e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.059899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9045bd-fff8-4342-90be-392e4f35e8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.060546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9045bd-fff8-4342-90be-392e4f35e8b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:12.060846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9045bd-fff8-4342-90be-392e4f35e8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.062255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9045bd-fff8-4342-90be-392e4f35e8b7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.070146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 280/567] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:12.070928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9045bd-fff8-4342-90be-392e4f35e8b7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.082679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d3340-d7d1-4de3-9096-2f47030c7de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.083314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d3340-d7d1-4de3-9096-2f47030c7de3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.083588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d3340-d7d1-4de3-9096-2f47030c7de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.083852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d3340-d7d1-4de3-9096-2f47030c7de3 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.084590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d3340-d7d1-4de3-9096-2f47030c7de3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:12.084891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d3340-d7d1-4de3-9096-2f47030c7de3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.086357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d3340-d7d1-4de3-9096-2f47030c7de3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.090426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:12.103747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 288/568] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Sep 19 16:57:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:12.104545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d3340-d7d1-4de3-9096-2f47030c7de3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.174984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9045bd-fff8-4342-90be-392e4f35e8b7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.200614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d3340-d7d1-4de3-9096-2f47030c7de3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.207374 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1910d9-a4e2-4813-85c1-494e38262b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.208000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1910d9-a4e2-4813-85c1-494e38262b21 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.208280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1910d9-a4e2-4813-85c1-494e38262b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.208552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1910d9-a4e2-4813-85c1-494e38262b21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.215509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1910d9-a4e2-4813-85c1-494e38262b21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.216986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1910d9-a4e2-4813-85c1-494e38262b21 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7e1910d9-a4e2-4813-85c1-494e38262b21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:12.228235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:12.229315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:12.230318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:12.230318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:12.230318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:12.230318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:12.230318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:12.230318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:12.230318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:12.230318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:12.230318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 281/569] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:12.230906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52bf89-dab8-428d-b0ca-112916d72450 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.230906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52bf89-dab8-428d-b0ca-112916d72450 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.231155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52bf89-dab8-428d-b0ca-112916d72450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.235626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:12.241021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cac4b-08f0-453a-96d1-fa6fb8fdc3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.241657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cac4b-08f0-453a-96d1-fa6fb8fdc3ae None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.241930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cac4b-08f0-453a-96d1-fa6fb8fdc3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.242197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cac4b-08f0-453a-96d1-fa6fb8fdc3ae None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.242853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cac4b-08f0-453a-96d1-fa6fb8fdc3ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:12.243173 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cac4b-08f0-453a-96d1-fa6fb8fdc3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.244534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6cac4b-08f0-453a-96d1-fa6fb8fdc3ae None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.248931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3b52bf89-dab8-428d-b0ca-112916d72450 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:12.250174 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3b52bf89-dab8-428d-b0ca-112916d72450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:12.252745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 289/570] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:12.253549 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cac4b-08f0-453a-96d1-fa6fb8fdc3ae None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.316709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 282/571] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:12.317534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52bf89-dab8-428d-b0ca-112916d72450 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.327344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:12.360838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cac4b-08f0-453a-96d1-fa6fb8fdc3ae None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.397237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe613c1-7a2d-444d-9420-12ff7d340ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.397873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe613c1-7a2d-444d-9420-12ff7d340ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.398152 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe613c1-7a2d-444d-9420-12ff7d340ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.398422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe613c1-7a2d-444d-9420-12ff7d340ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.408702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe613c1-7a2d-444d-9420-12ff7d340ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.410197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe613c1-7a2d-444d-9420-12ff7d340ee8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ffe613c1-7a2d-444d-9420-12ff7d340ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:12.423979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:12.425156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:12.426229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:12.426229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:12.426229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:12.426229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 290/572] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:12.426229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe613c1-7a2d-444d-9420-12ff7d340ee8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.428082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52bf89-dab8-428d-b0ca-112916d72450 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.467629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a935d44-a540-422a-875f-814b8dd12b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.468541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a935d44-a540-422a-875f-814b8dd12b48 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.468842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a935d44-a540-422a-875f-814b8dd12b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.469177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a935d44-a540-422a-875f-814b8dd12b48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.472626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:12.481350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a935d44-a540-422a-875f-814b8dd12b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.482808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a935d44-a540-422a-875f-814b8dd12b48 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5a935d44-a540-422a-875f-814b8dd12b48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:12.497646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:12.498563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:12.499425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:12.499425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:12.499425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:12.499425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 283/573] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:12.499642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a935d44-a540-422a-875f-814b8dd12b48 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.535625 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe613c1-7a2d-444d-9420-12ff7d340ee8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.560355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:12.571900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9b027-14c5-40e1-905e-ad7f7227df3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.572449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9b027-14c5-40e1-905e-ad7f7227df3b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.572721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9b027-14c5-40e1-905e-ad7f7227df3b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.572988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9b027-14c5-40e1-905e-ad7f7227df3b None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.573745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9b027-14c5-40e1-905e-ad7f7227df3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:12.574051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9b027-14c5-40e1-905e-ad7f7227df3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.575483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9b027-14c5-40e1-905e-ad7f7227df3b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.593009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 291/574] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:12.593840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9b027-14c5-40e1-905e-ad7f7227df3b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.605329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a935d44-a540-422a-875f-814b8dd12b48 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.638489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785a7e7-1d4e-4d0a-8c45-cb12b397e939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.639110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a7e7-1d4e-4d0a-8c45-cb12b397e939 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.639416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a7e7-1d4e-4d0a-8c45-cb12b397e939 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.639715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785a7e7-1d4e-4d0a-8c45-cb12b397e939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.650517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785a7e7-1d4e-4d0a-8c45-cb12b397e939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.651981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785a7e7-1d4e-4d0a-8c45-cb12b397e939 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b785a7e7-1d4e-4d0a-8c45-cb12b397e939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:12.665677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:12.666630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:12.667977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:12.667977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:12.667977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:12.667977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 284/575] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:12.667977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785a7e7-1d4e-4d0a-8c45-cb12b397e939 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.696734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9b027-14c5-40e1-905e-ad7f7227df3b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.699245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:12.731501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8687c-4681-4bcf-9c12-c9eb16f5e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.732116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8687c-4681-4bcf-9c12-c9eb16f5e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.732397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8687c-4681-4bcf-9c12-c9eb16f5e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.732667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8687c-4681-4bcf-9c12-c9eb16f5e8e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.733345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8687c-4681-4bcf-9c12-c9eb16f5e8e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:12.733645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8687c-4681-4bcf-9c12-c9eb16f5e8e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.735016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8687c-4681-4bcf-9c12-c9eb16f5e8e0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.746218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 292/576] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:12.746996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8687c-4681-4bcf-9c12-c9eb16f5e8e0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.770243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785a7e7-1d4e-4d0a-8c45-cb12b397e939 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.780870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:12.804301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4d033-3cc5-4da5-b469-a9a96c0ed610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.804908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4d033-3cc5-4da5-b469-a9a96c0ed610 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.805218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4d033-3cc5-4da5-b469-a9a96c0ed610 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.805485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4d033-3cc5-4da5-b469-a9a96c0ed610 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.806120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4d033-3cc5-4da5-b469-a9a96c0ed610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:12.806421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4d033-3cc5-4da5-b469-a9a96c0ed610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.807789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4d033-3cc5-4da5-b469-a9a96c0ed610 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.820069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 285/577] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:12.820866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4d033-3cc5-4da5-b469-a9a96c0ed610 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.846358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8687c-4681-4bcf-9c12-c9eb16f5e8e0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.879637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36327592-7cb4-4c8f-9ac5-bcd282d84f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.880333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36327592-7cb4-4c8f-9ac5-bcd282d84f26 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.880615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36327592-7cb4-4c8f-9ac5-bcd282d84f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.880893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36327592-7cb4-4c8f-9ac5-bcd282d84f26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.891011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36327592-7cb4-4c8f-9ac5-bcd282d84f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-36327592-7cb4-4c8f-9ac5-bcd282d84f26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:12.896546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:12.897679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 293/578] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:12.898508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36327592-7cb4-4c8f-9ac5-bcd282d84f26 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:12.922300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4d033-3cc5-4da5-b469-a9a96c0ed610 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:12.923766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:12.956279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed665a45-6f3d-4beb-8e8c-973ff7a20975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:12.956929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665a45-6f3d-4beb-8e8c-973ff7a20975 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:12.957225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665a45-6f3d-4beb-8e8c-973ff7a20975 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:12.957518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665a45-6f3d-4beb-8e8c-973ff7a20975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:12.958281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed665a45-6f3d-4beb-8e8c-973ff7a20975 None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=8834ef19c2604e8c828aa4dd32db61a7) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:12.958588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed665a45-6f3d-4beb-8e8c-973ff7a20975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:12.960016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed665a45-6f3d-4beb-8e8c-973ff7a20975 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:12.965958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 286/579] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/role_assignments?user.id=8834ef19c2604e8c828aa4dd32db61a7&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:12.966571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed665a45-6f3d-4beb-8e8c-973ff7a20975 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.004850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:13.017520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36327592-7cb4-4c8f-9ac5-bcd282d84f26 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.054873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a736-3fc5-4572-97ac-ecd2595a5248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.055501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a736-3fc5-4572-97ac-ecd2595a5248 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.055781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a736-3fc5-4572-97ac-ecd2595a5248 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.056052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a736-3fc5-4572-97ac-ecd2595a5248 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.056724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6a736-3fc5-4572-97ac-ecd2595a5248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:13.057025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6a736-3fc5-4572-97ac-ecd2595a5248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.058490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6a736-3fc5-4572-97ac-ecd2595a5248 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.071590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 294/580] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:13.072469 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a736-3fc5-4572-97ac-ecd2595a5248 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.087365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed665a45-6f3d-4beb-8e8c-973ff7a20975 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.124637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f63fb-2330-45b7-8dd0-120b74ab6014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.125631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f63fb-2330-45b7-8dd0-120b74ab6014 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.126085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f63fb-2330-45b7-8dd0-120b74ab6014 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.126550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f63fb-2330-45b7-8dd0-120b74ab6014 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.137797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f63fb-2330-45b7-8dd0-120b74ab6014 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.138712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f63fb-2330-45b7-8dd0-120b74ab6014 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-1f2f63fb-2330-45b7-8dd0-120b74ab6014 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:13.151386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:13.152367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 287/581] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:13.153434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f63fb-2330-45b7-8dd0-120b74ab6014 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.181759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:13.200150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a736-3fc5-4572-97ac-ecd2595a5248 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.234478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7073f0-29ab-4fdc-8324-216f08c436d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.235407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7073f0-29ab-4fdc-8324-216f08c436d7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.235685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7073f0-29ab-4fdc-8324-216f08c436d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.235960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7073f0-29ab-4fdc-8324-216f08c436d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.242688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7073f0-29ab-4fdc-8324-216f08c436d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.244142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7073f0-29ab-4fdc-8324-216f08c436d7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.252175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6e7073f0-29ab-4fdc-8324-216f08c436d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:13.255616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:13.256644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:13.257775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:13.257775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:13.257775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:13.257775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:13.257775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:13.257775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:13.257775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:13.257775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:13.261649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 295/582] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:13.262495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7073f0-29ab-4fdc-8324-216f08c436d7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.262693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f63fb-2330-45b7-8dd0-120b74ab6014 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.299970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2b84c-a9e1-4a58-8cf6-a3b755857ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.300222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2b84c-a9e1-4a58-8cf6-a3b755857ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.300569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2b84c-a9e1-4a58-8cf6-a3b755857ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.300899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2b84c-a9e1-4a58-8cf6-a3b755857ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.301647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2b84c-a9e1-4a58-8cf6-a3b755857ca7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:13.302103 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2b84c-a9e1-4a58-8cf6-a3b755857ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.303885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2b84c-a9e1-4a58-8cf6-a3b755857ca7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.312254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 288/583] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:13.313014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2b84c-a9e1-4a58-8cf6-a3b755857ca7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.371349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7073f0-29ab-4fdc-8324-216f08c436d7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.410642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660e7f9-dbf0-4ecc-8698-4a859762d8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.411220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e7f9-dbf0-4ecc-8698-4a859762d8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.411500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e7f9-dbf0-4ecc-8698-4a859762d8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.411765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660e7f9-dbf0-4ecc-8698-4a859762d8a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.419903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660e7f9-dbf0-4ecc-8698-4a859762d8a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.421366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660e7f9-dbf0-4ecc-8698-4a859762d8a1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.425569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2b84c-a9e1-4a58-8cf6-a3b755857ca7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6660e7f9-dbf0-4ecc-8698-4a859762d8a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:13.434283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:13.435420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:13.436531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:13.436531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:13.436531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:13.436531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:13.436531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:13.436531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:13.436531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:13.436531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:13.436531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:57:13.436531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:13.440109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 296/584] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:13.440784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660e7f9-dbf0-4ecc-8698-4a859762d8a1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.444440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:13.468603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1585b79-5e34-42d8-819d-4b2509fde020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.469646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585b79-5e34-42d8-819d-4b2509fde020 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.469996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585b79-5e34-42d8-819d-4b2509fde020 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.470333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1585b79-5e34-42d8-819d-4b2509fde020 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.471417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1585b79-5e34-42d8-819d-4b2509fde020 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:13.471789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1585b79-5e34-42d8-819d-4b2509fde020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.473327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1585b79-5e34-42d8-819d-4b2509fde020 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.495736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 289/585] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Sep 19 16:57:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:13.495736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1585b79-5e34-42d8-819d-4b2509fde020 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.509429 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:13.559587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660e7f9-dbf0-4ecc-8698-4a859762d8a1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.598440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1585b79-5e34-42d8-819d-4b2509fde020 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.599908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45001dd1-2929-47f2-b2ca-6266db3103f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.600529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45001dd1-2929-47f2-b2ca-6266db3103f0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.601449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45001dd1-2929-47f2-b2ca-6266db3103f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.601449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45001dd1-2929-47f2-b2ca-6266db3103f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.601847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45001dd1-2929-47f2-b2ca-6266db3103f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:13.602156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45001dd1-2929-47f2-b2ca-6266db3103f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.603607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45001dd1-2929-47f2-b2ca-6266db3103f0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.617793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 297/586] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:13.618607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45001dd1-2929-47f2-b2ca-6266db3103f0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.642168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333086d-e10b-40cc-a3cb-d9042d8e9cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.642803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333086d-e10b-40cc-a3cb-d9042d8e9cad None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.643116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333086d-e10b-40cc-a3cb-d9042d8e9cad None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.643347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333086d-e10b-40cc-a3cb-d9042d8e9cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.654344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333086d-e10b-40cc-a3cb-d9042d8e9cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.655822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333086d-e10b-40cc-a3cb-d9042d8e9cad None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d333086d-e10b-40cc-a3cb-d9042d8e9cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:13.671604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:13.672571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:13.673493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:13.673493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:13.673493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:13.673493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 290/587] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:13.674270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333086d-e10b-40cc-a3cb-d9042d8e9cad None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.691468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:13.739025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45001dd1-2929-47f2-b2ca-6266db3103f0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.744522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:13.774179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252959a1-6f0f-498a-9367-bc6b1da833a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.774821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252959a1-6f0f-498a-9367-bc6b1da833a1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.775103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252959a1-6f0f-498a-9367-bc6b1da833a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.775444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252959a1-6f0f-498a-9367-bc6b1da833a1 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.776187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252959a1-6f0f-498a-9367-bc6b1da833a1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:13.776538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252959a1-6f0f-498a-9367-bc6b1da833a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.778032 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252959a1-6f0f-498a-9367-bc6b1da833a1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.783365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333086d-e10b-40cc-a3cb-d9042d8e9cad None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.800085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 298/588] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Sep 19 16:57:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:13.800085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252959a1-6f0f-498a-9367-bc6b1da833a1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.830257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c20fd6-af52-464e-910d-1a5c8cd03317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.831038 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c20fd6-af52-464e-910d-1a5c8cd03317 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.831312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c20fd6-af52-464e-910d-1a5c8cd03317 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.831585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c20fd6-af52-464e-910d-1a5c8cd03317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.844726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c20fd6-af52-464e-910d-1a5c8cd03317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.846241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c20fd6-af52-464e-910d-1a5c8cd03317 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-63c20fd6-af52-464e-910d-1a5c8cd03317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:13.860509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:13.861711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:13.862614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:13.862614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:13.862614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:13.862614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 291/589] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:13.862614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c20fd6-af52-464e-910d-1a5c8cd03317 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.905535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252959a1-6f0f-498a-9367-bc6b1da833a1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.929094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:13.940854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32434a6-6555-4d88-993f-2367ef162be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:13.941547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32434a6-6555-4d88-993f-2367ef162be3 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:13.941822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32434a6-6555-4d88-993f-2367ef162be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:13.942085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32434a6-6555-4d88-993f-2367ef162be3 None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/ea18c782ddf2469fa3d10a135fc34c37/roles/0af1ff2cf6f948529ec7cece6eca90d4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:13.956750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32434a6-6555-4d88-993f-2367ef162be3 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=ea18c782ddf2469fa3d10a135fc34c37, role_id=0af1ff2cf6f948529ec7cece6eca90d4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:13.958440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32434a6-6555-4d88-993f-2367ef162be3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:13.966342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c20fd6-af52-464e-910d-1a5c8cd03317 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:13.972136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 299/590] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:57:13 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/ea18c782ddf2469fa3d10a135fc34c37/roles/0af1ff2cf6f948529ec7cece6eca90d4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:57:13.972722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32434a6-6555-4d88-993f-2367ef162be3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:13.993408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:14.018698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d386303-2899-4fa6-8b41-e31232d20638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.020180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386303-2899-4fa6-8b41-e31232d20638 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.020762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386303-2899-4fa6-8b41-e31232d20638 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:14.021300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386303-2899-4fa6-8b41-e31232d20638 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:14.022879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d386303-2899-4fa6-8b41-e31232d20638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:14.023389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d386303-2899-4fa6-8b41-e31232d20638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:14.025599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d386303-2899-4fa6-8b41-e31232d20638 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:14.046906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 292/591] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:14.046906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d386303-2899-4fa6-8b41-e31232d20638 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:14.106299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32434a6-6555-4d88-993f-2367ef162be3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:14.164596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238546fa-0d43-4fd8-a4ec-07b78c1259b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.165273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238546fa-0d43-4fd8-a4ec-07b78c1259b6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.165554 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238546fa-0d43-4fd8-a4ec-07b78c1259b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:14.165827 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238546fa-0d43-4fd8-a4ec-07b78c1259b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:14.179920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238546fa-0d43-4fd8-a4ec-07b78c1259b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:14.181383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238546fa-0d43-4fd8-a4ec-07b78c1259b6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:14.183414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d386303-2899-4fa6-8b41-e31232d20638 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-238546fa-0d43-4fd8-a4ec-07b78c1259b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:14.198027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:14.199002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:14.199900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:14.199900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:14.199900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:14.199900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 300/592] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:14.200704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238546fa-0d43-4fd8-a4ec-07b78c1259b6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:14.226308 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9b59-8cc6-4dce-9e4c-a1e40d9efbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.227044 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9b59-8cc6-4dce-9e4c-a1e40d9efbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.227327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9b59-8cc6-4dce-9e4c-a1e40d9efbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:14.227600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9b59-8cc6-4dce-9e4c-a1e40d9efbf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:14.228254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9b59-8cc6-4dce-9e4c-a1e40d9efbf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:14.228555 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9b59-8cc6-4dce-9e4c-a1e40d9efbf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:14.229956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9b59-8cc6-4dce-9e4c-a1e40d9efbf8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:14.231668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:14.247218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 293/593] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:14.248088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9b59-8cc6-4dce-9e4c-a1e40d9efbf8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:14.300303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:14.330869 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238546fa-0d43-4fd8-a4ec-07b78c1259b6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:14.374266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9b59-8cc6-4dce-9e4c-a1e40d9efbf8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:14.376609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0359-631e-4faf-b179-bb82874a0643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.378664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0359-631e-4faf-b179-bb82874a0643 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.379096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0359-631e-4faf-b179-bb82874a0643 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:14.379513 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0359-631e-4faf-b179-bb82874a0643 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:14.389451 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b0359-631e-4faf-b179-bb82874a0643 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:14.391802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b0359-631e-4faf-b179-bb82874a0643 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4e9b0359-631e-4faf-b179-bb82874a0643 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:14.408488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:14.409648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:14.410788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:14.410788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:14.410788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:14.410788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:14.410788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:14.410788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:14.410788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:14.410788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:14.410788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:57:14.410788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:14.413153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 301/594] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:14.414134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0359-631e-4faf-b179-bb82874a0643 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:14.414460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58806fe6-ff5c-4b7c-8371-f4ceef1de488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.415426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806fe6-ff5c-4b7c-8371-f4ceef1de488 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.415812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806fe6-ff5c-4b7c-8371-f4ceef1de488 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:14.416219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806fe6-ff5c-4b7c-8371-f4ceef1de488 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:14.416991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58806fe6-ff5c-4b7c-8371-f4ceef1de488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:14.417437 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58806fe6-ff5c-4b7c-8371-f4ceef1de488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:14.419909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58806fe6-ff5c-4b7c-8371-f4ceef1de488 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:14.433585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 294/595] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:14.434487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58806fe6-ff5c-4b7c-8371-f4ceef1de488 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:14.527530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:14.548883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:14.551929 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0359-631e-4faf-b179-bb82874a0643 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:14.553960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58806fe6-ff5c-4b7c-8371-f4ceef1de488 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:14.592867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10f2a-6609-491b-8494-331ef70fe88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.593760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10f2a-6609-491b-8494-331ef70fe88c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.594258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10f2a-6609-491b-8494-331ef70fe88c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:14.594635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10f2a-6609-491b-8494-331ef70fe88c None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:14.595685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e10f2a-6609-491b-8494-331ef70fe88c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:14.596170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e10f2a-6609-491b-8494-331ef70fe88c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:14.596780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b8b87-da35-4cd0-ab53-15ab6ad00301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.597671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8b87-da35-4cd0-ab53-15ab6ad00301 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.597917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e10f2a-6609-491b-8494-331ef70fe88c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:14.598270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8b87-da35-4cd0-ab53-15ab6ad00301 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:14.598820 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b8b87-da35-4cd0-ab53-15ab6ad00301 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:14.607799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b8b87-da35-4cd0-ab53-15ab6ad00301 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:14.610398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b8b87-da35-4cd0-ab53-15ab6ad00301 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:14.617986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 295/596] 10.222.0.76 () {56 vars in 1139 bytes} [Mon Sep 19 16:57:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:14.619181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10f2a-6609-491b-8494-331ef70fe88c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-bd9b8b87-da35-4cd0-ab53-15ab6ad00301 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:14.625447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:14.626523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:14.627618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:14.627618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:14.627618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:14.627618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:14.627618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:14.627618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:14.627618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:14.627618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:14.629958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 302/597] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:14.630884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b8b87-da35-4cd0-ab53-15ab6ad00301 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:14.741514 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b8b87-da35-4cd0-ab53-15ab6ad00301 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:14.746745 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10f2a-6609-491b-8494-331ef70fe88c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:14.777981 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135b3d-9f25-45d4-9469-f769e2478dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.779029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135b3d-9f25-45d4-9469-f769e2478dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.779196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135b3d-9f25-45d4-9469-f769e2478dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:14.779560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135b3d-9f25-45d4-9469-f769e2478dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:14.787461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75ebe1-3225-4e26-9e26-b9bd81dc144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.788475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75ebe1-3225-4e26-9e26-b9bd81dc144e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.788905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75ebe1-3225-4e26-9e26-b9bd81dc144e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:14.789372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75ebe1-3225-4e26-9e26-b9bd81dc144e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:14.792117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5135b3d-9f25-45d4-9469-f769e2478dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:14.793707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5135b3d-9f25-45d4-9469-f769e2478dd1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:14.796702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:14.802168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75ebe1-3225-4e26-9e26-b9bd81dc144e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:14.805371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75ebe1-3225-4e26-9e26-b9bd81dc144e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e5135b3d-9f25-45d4-9469-f769e2478dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:14.810450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:14.811674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:14.812802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:14.812802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:14.812802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:14.814494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 303/598] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:14.815488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135b3d-9f25-45d4-9469-f769e2478dd1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8c75ebe1-3225-4e26-9e26-b9bd81dc144e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:14.821844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:14.822979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:14.824106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:14.824106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:14.824106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:14.824106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:14.824106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:14.824106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:14.824106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:14.824106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:14.826264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 296/599] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:14.827398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75ebe1-3225-4e26-9e26-b9bd81dc144e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:14.849626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:14.925115 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135b3d-9f25-45d4-9469-f769e2478dd1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:14.954069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75ebe1-3225-4e26-9e26-b9bd81dc144e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:14.961519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c8afc-8b62-4d87-827e-ffdb90a4a04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.962216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8afc-8b62-4d87-827e-ffdb90a4a04e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.962563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8afc-8b62-4d87-827e-ffdb90a4a04e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:14.963189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8afc-8b62-4d87-827e-ffdb90a4a04e None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:14.963678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c8afc-8b62-4d87-827e-ffdb90a4a04e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:14.964054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c8afc-8b62-4d87-827e-ffdb90a4a04e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:14.965660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c8afc-8b62-4d87-827e-ffdb90a4a04e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:14.985073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 304/600] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:14.986692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c8afc-8b62-4d87-827e-ffdb90a4a04e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:14.998351 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3751b-48cd-41b9-a70c-06ead06b75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:14.999412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3751b-48cd-41b9-a70c-06ead06b75fb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:14.999881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3751b-48cd-41b9-a70c-06ead06b75fb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:15.000343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3751b-48cd-41b9-a70c-06ead06b75fb None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:15.001346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3751b-48cd-41b9-a70c-06ead06b75fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:15.001861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3751b-48cd-41b9-a70c-06ead06b75fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:15.003456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3751b-48cd-41b9-a70c-06ead06b75fb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:15.020814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 297/601] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:15.021981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3751b-48cd-41b9-a70c-06ead06b75fb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:15.057751 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:15.109577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:15.113608 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c8afc-8b62-4d87-827e-ffdb90a4a04e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:15.135006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3751b-48cd-41b9-a70c-06ead06b75fb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:15.150432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79e029-a5e8-4e93-a28d-4269d07fdf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:15.151055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e029-a5e8-4e93-a28d-4269d07fdf67 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:15.151336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e029-a5e8-4e93-a28d-4269d07fdf67 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:15.151609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e029-a5e8-4e93-a28d-4269d07fdf67 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:15.152309 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79e029-a5e8-4e93-a28d-4269d07fdf67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:15.152611 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79e029-a5e8-4e93-a28d-4269d07fdf67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:15.154095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79e029-a5e8-4e93-a28d-4269d07fdf67 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:15.166180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 305/602] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:15.167002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79e029-a5e8-4e93-a28d-4269d07fdf67 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:15.175140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f051cc8-02bf-45c8-9e12-fd6dcf034a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:15.176224 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f051cc8-02bf-45c8-9e12-fd6dcf034a4a None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:15.176568 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f051cc8-02bf-45c8-9e12-fd6dcf034a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:15.176879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f051cc8-02bf-45c8-9e12-fd6dcf034a4a None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/2c746178628e4df5961982268e642ff7/roles/0af1ff2cf6f948529ec7cece6eca90d4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:15.194263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f051cc8-02bf-45c8-9e12-fd6dcf034a4a None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=2c746178628e4df5961982268e642ff7, role_id=0af1ff2cf6f948529ec7cece6eca90d4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:15.195940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f051cc8-02bf-45c8-9e12-fd6dcf034a4a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:15.221327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 298/603] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:57:15 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/2c746178628e4df5961982268e642ff7/roles/0af1ff2cf6f948529ec7cece6eca90d4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:57:15.221327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abff33-4615-4e65-aa08-e7d8fcc28f60 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:15.221327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abff33-4615-4e65-aa08-e7d8fcc28f60 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:15.221327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abff33-4615-4e65-aa08-e7d8fcc28f60 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:15.221327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 299/604] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:15.221327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abff33-4615-4e65-aa08-e7d8fcc28f60 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:15.317903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79e029-a5e8-4e93-a28d-4269d07fdf67 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:15.341320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:15.348424 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abff33-4615-4e65-aa08-e7d8fcc28f60 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:15.361715 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab5503-16b2-4637-a7ef-353cdbe36cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:15.362548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5503-16b2-4637-a7ef-353cdbe36cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:15.362921 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5503-16b2-4637-a7ef-353cdbe36cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:15.363312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5503-16b2-4637-a7ef-353cdbe36cf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:15.370948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab5503-16b2-4637-a7ef-353cdbe36cf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:15.372585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab5503-16b2-4637-a7ef-353cdbe36cf7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:15.378660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-34ab5503-16b2-4637-a7ef-353cdbe36cf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:15.386854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:15.388180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:15.389620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:15.389620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:15.389620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:15.389620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:15.389620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:15.389620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:15.389620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:15.389620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:15.389620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 306/605] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:15.393556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd0cb-52d8-4a5a-b8a1-9d4dc4212a41 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:15.393556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd0cb-52d8-4a5a-b8a1-9d4dc4212a41 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:15.393556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdd0cb-52d8-4a5a-b8a1-9d4dc4212a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:15.396076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7314c30-8cfb-463e-9085-f8f80640fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:15.396900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314c30-8cfb-463e-9085-f8f80640fd4d None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:15.397010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314c30-8cfb-463e-9085-f8f80640fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:15.397303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314c30-8cfb-463e-9085-f8f80640fd4d None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/7338fa9ff18c42f8bc26710ab8376b3f/roles/0af1ff2cf6f948529ec7cece6eca90d4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:15.414157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a1cdd0cb-52d8-4a5a-b8a1-9d4dc4212a41 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:15.415680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a1cdd0cb-52d8-4a5a-b8a1-9d4dc4212a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:15.417826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7314c30-8cfb-463e-9085-f8f80640fd4d None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=7338fa9ff18c42f8bc26710ab8376b3f, role_id=0af1ff2cf6f948529ec7cece6eca90d4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:15.420736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7314c30-8cfb-463e-9085-f8f80640fd4d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:15.439051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 300/606] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:57:15 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/7338fa9ff18c42f8bc26710ab8376b3f/roles/0af1ff2cf6f948529ec7cece6eca90d4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:57:15.440348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7314c30-8cfb-463e-9085-f8f80640fd4d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:15.513327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 307/607] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:15.554853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7314c30-8cfb-463e-9085-f8f80640fd4d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:15.590642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c558d-6117-4dd8-acf0-f38a1078ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:15.591620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c558d-6117-4dd8-acf0-f38a1078ab52 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:15.592093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c558d-6117-4dd8-acf0-f38a1078ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:15.592555 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c558d-6117-4dd8-acf0-f38a1078ab52 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:15.593489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c558d-6117-4dd8-acf0-f38a1078ab52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:15.593984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c558d-6117-4dd8-acf0-f38a1078ab52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:15.595613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c558d-6117-4dd8-acf0-f38a1078ab52 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:15.608610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 301/608] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:15.614447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd0cb-52d8-4a5a-b8a1-9d4dc4212a41 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:15.748643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdd0cb-52d8-4a5a-b8a1-9d4dc4212a41 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:15.756974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:15.788071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438a044-8869-46cf-bad7-3e35c8b303a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:15.789156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a044-8869-46cf-bad7-3e35c8b303a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:15.789628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a044-8869-46cf-bad7-3e35c8b303a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:15.790103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438a044-8869-46cf-bad7-3e35c8b303a0 None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/da4a83dd0cb64e219bc16f8cf0b0af57/roles/0af1ff2cf6f948529ec7cece6eca90d4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:15.805491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a044-8869-46cf-bad7-3e35c8b303a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=da4a83dd0cb64e219bc16f8cf0b0af57, role_id=0af1ff2cf6f948529ec7cece6eca90d4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:15.807231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438a044-8869-46cf-bad7-3e35c8b303a0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:15.825914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 308/609] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:57:15 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/da4a83dd0cb64e219bc16f8cf0b0af57/roles/0af1ff2cf6f948529ec7cece6eca90d4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:57:15.851036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c558d-6117-4dd8-acf0-f38a1078ab52 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:15.908723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:15.996519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c558d-6117-4dd8-acf0-f38a1078ab52 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:16.034288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7444d-cac1-4628-9794-4f70241bc1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:16.034940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7444d-cac1-4628-9794-4f70241bc1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:16.035222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7444d-cac1-4628-9794-4f70241bc1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:16.035496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7444d-cac1-4628-9794-4f70241bc1a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:16.046991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7444d-cac1-4628-9794-4f70241bc1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-64f7444d-cac1-4628-9794-4f70241bc1a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:16.052024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:16.052978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:16.053842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 302/610] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:16.060984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438a044-8869-46cf-bad7-3e35c8b303a0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:16.194658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438a044-8869-46cf-bad7-3e35c8b303a0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:16.253158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e068-3e52-45c7-9582-d3def95d56c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:16.253794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e068-3e52-45c7-9582-d3def95d56c8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:16.254077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e068-3e52-45c7-9582-d3def95d56c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:16.254349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e068-3e52-45c7-9582-d3def95d56c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:16.255202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e068-3e52-45c7-9582-d3def95d56c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:16.255501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e068-3e52-45c7-9582-d3def95d56c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:16.256889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e068-3e52-45c7-9582-d3def95d56c8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:16.266002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 309/611] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:16.271915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7444d-cac1-4628-9794-4f70241bc1a7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:16.396446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:16.403344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7444d-cac1-4628-9794-4f70241bc1a7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:16.423118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd85e2b-c68a-4882-bee6-708ffc3fbb01 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:16.424084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd85e2b-c68a-4882-bee6-708ffc3fbb01 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:16.424574 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd85e2b-c68a-4882-bee6-708ffc3fbb01 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:16.430454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 310/612] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:16.437316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65d3aa-71e3-416e-b8b4-4a2d790d1ab9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:16.437848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65d3aa-71e3-416e-b8b4-4a2d790d1ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:16.438501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65d3aa-71e3-416e-b8b4-4a2d790d1ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:16.439600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4797c9-528b-4fb4-9503-a19e07fe5503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:16.440240 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4797c9-528b-4fb4-9503-a19e07fe5503 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:16.440520 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4797c9-528b-4fb4-9503-a19e07fe5503 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:16.440793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4797c9-528b-4fb4-9503-a19e07fe5503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:16.451963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4797c9-528b-4fb4-9503-a19e07fe5503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:16.454493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4797c9-528b-4fb4-9503-a19e07fe5503 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ed4797c9-528b-4fb4-9503-a19e07fe5503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:16.470558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:16.471532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:16.472410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:16.472410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:16.472410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:16.472410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 303/613] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:16.480641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0f65d3aa-71e3-416e-b8b4-4a2d790d1ab9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:16.482064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4797c9-528b-4fb4-9503-a19e07fe5503 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:16.482471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0f65d3aa-71e3-416e-b8b4-4a2d790d1ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:16.515872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:16.599223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4797c9-528b-4fb4-9503-a19e07fe5503 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:16.653260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 311/614] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:16.662163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71d335-4013-49ea-a581-3542c8693ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:16.662963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71d335-4013-49ea-a581-3542c8693ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:16.663393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71d335-4013-49ea-a581-3542c8693ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:16.663807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71d335-4013-49ea-a581-3542c8693ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:16.664595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71d335-4013-49ea-a581-3542c8693ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:16.665080 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71d335-4013-49ea-a581-3542c8693ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:16.666612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71d335-4013-49ea-a581-3542c8693ce4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:16.684620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 304/615] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:16.689916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65d3aa-71e3-416e-b8b4-4a2d790d1ab9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:16.819025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65d3aa-71e3-416e-b8b4-4a2d790d1ab9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:16.861526 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184326e-6034-431f-9bf0-2c65a5ae5bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:16.862422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184326e-6034-431f-9bf0-2c65a5ae5bee None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:16.862842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184326e-6034-431f-9bf0-2c65a5ae5bee None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:16.863253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184326e-6034-431f-9bf0-2c65a5ae5bee None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:16.871102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184326e-6034-431f-9bf0-2c65a5ae5bee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:16.872773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184326e-6034-431f-9bf0-2c65a5ae5bee None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7184326e-6034-431f-9bf0-2c65a5ae5bee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:16.885000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:16.886150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:16.887305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:16.887305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:16.887305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:16.887305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:16.887305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:16.887305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:16.887305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:16.887305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:16.887305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:16.887305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:16.889462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 312/616] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:16.898137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71d335-4013-49ea-a581-3542c8693ce4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:16.910863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:17.024745 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71d335-4013-49ea-a581-3542c8693ce4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:17.074515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd138d-31e3-4ba1-9e05-04db115c6527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:17.075159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd138d-31e3-4ba1-9e05-04db115c6527 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:17.075438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd138d-31e3-4ba1-9e05-04db115c6527 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:17.075709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd138d-31e3-4ba1-9e05-04db115c6527 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:17.076455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd138d-31e3-4ba1-9e05-04db115c6527 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:17.076758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd138d-31e3-4ba1-9e05-04db115c6527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:17.078223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd138d-31e3-4ba1-9e05-04db115c6527 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:17.098200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 305/617] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Sep 19 16:57:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:17.105478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184326e-6034-431f-9bf0-2c65a5ae5bee None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:17.123066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:17.155569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd138d-31e3-4ba1-9e05-04db115c6527 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:17.260907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184326e-6034-431f-9bf0-2c65a5ae5bee None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:17.274061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:17.303877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bfa7f-d313-440f-8b0d-363cba50b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:17.304896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bfa7f-d313-440f-8b0d-363cba50b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:17.305538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bfa7f-d313-440f-8b0d-363cba50b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:17.306070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bfa7f-d313-440f-8b0d-363cba50b1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:17.330606 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bfa7f-d313-440f-8b0d-363cba50b1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:17.332387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bfa7f-d313-440f-8b0d-363cba50b1f2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:17.332775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd138d-31e3-4ba1-9e05-04db115c6527 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5b4bfa7f-d313-440f-8b0d-363cba50b1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:17.358411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:17.359388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:17.360271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:17.360271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:17.360271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:17.362522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 313/618] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:17.371320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bfa7f-d313-440f-8b0d-363cba50b1f2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:17.375098 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c0a82-eb76-469e-a61e-f069bfc5497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:17.375755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c0a82-eb76-469e-a61e-f069bfc5497f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:17.376037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c0a82-eb76-469e-a61e-f069bfc5497f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:17.376308 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c0a82-eb76-469e-a61e-f069bfc5497f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:17.400753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c0a82-eb76-469e-a61e-f069bfc5497f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b97c0a82-eb76-469e-a61e-f069bfc5497f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:17.406418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:17.407485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:17.408306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:17.412954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 306/619] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:17.419458 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c0a82-eb76-469e-a61e-f069bfc5497f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:17.486437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:17.562693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bfa7f-d313-440f-8b0d-363cba50b1f2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:17.595649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c0a82-eb76-469e-a61e-f069bfc5497f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:17.625510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076e7d4-b460-46b9-84aa-c1e8bd4878cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:17.626135 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e7d4-b460-46b9-84aa-c1e8bd4878cd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:17.626410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e7d4-b460-46b9-84aa-c1e8bd4878cd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:17.626680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e7d4-b460-46b9-84aa-c1e8bd4878cd None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:17.627345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076e7d4-b460-46b9-84aa-c1e8bd4878cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:17.627649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076e7d4-b460-46b9-84aa-c1e8bd4878cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:17.629050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076e7d4-b460-46b9-84aa-c1e8bd4878cd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:17.653425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:17.654234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 314/620] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:17.659861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076e7d4-b460-46b9-84aa-c1e8bd4878cd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:17.665774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5552f-3259-4a28-af37-abfde8dbdd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:17.666397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5552f-3259-4a28-af37-abfde8dbdd12 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:17.666676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5552f-3259-4a28-af37-abfde8dbdd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:17.666948 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5552f-3259-4a28-af37-abfde8dbdd12 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:17.667620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5552f-3259-4a28-af37-abfde8dbdd12 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:17.667923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5552f-3259-4a28-af37-abfde8dbdd12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:17.669341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5552f-3259-4a28-af37-abfde8dbdd12 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:17.686899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 307/621] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:17.691425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5552f-3259-4a28-af37-abfde8dbdd12 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:17.844551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076e7d4-b460-46b9-84aa-c1e8bd4878cd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:17.864043 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5552f-3259-4a28-af37-abfde8dbdd12 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:17.867877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:17.884036 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757c195-474d-4adc-855f-86f428ae6292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:17.884672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757c195-474d-4adc-855f-86f428ae6292 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:17.884946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757c195-474d-4adc-855f-86f428ae6292 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:17.885260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757c195-474d-4adc-855f-86f428ae6292 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:17.892140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757c195-474d-4adc-855f-86f428ae6292 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:17.893639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757c195-474d-4adc-855f-86f428ae6292 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:17.901538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9eb33-a0b0-45b2-963f-24a6ac867cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:17.902308 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9eb33-a0b0-45b2-963f-24a6ac867cfd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:17.902659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9eb33-a0b0-45b2-963f-24a6ac867cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:17.903000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9eb33-a0b0-45b2-963f-24a6ac867cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e757c195-474d-4adc-855f-86f428ae6292 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:17.905289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:17.906212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:17.907781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:17.907781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:17.907781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:17.907781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:17.907781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:17.907781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:17.907781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:17.907781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:17.907781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 315/622] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:17.908930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962a0a4-d3f7-4d94-982c-b98cc2a01875 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:17.908930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962a0a4-d3f7-4d94-982c-b98cc2a01875 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:17.908930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962a0a4-d3f7-4d94-982c-b98cc2a01875 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:17.910694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 316/623] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:17.914082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962a0a4-d3f7-4d94-982c-b98cc2a01875 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:17.920243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9eb33-a0b0-45b2-963f-24a6ac867cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:17.921755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9eb33-a0b0-45b2-963f-24a6ac867cfd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-54c9eb33-a0b0-45b2-963f-24a6ac867cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:17.939739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:17.942027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:17.944127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:17.944127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:17.944127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:17.944127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 308/624] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:17.944127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e7308-1def-4fb0-8649-54b69e4c6fd8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:17.944127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e7308-1def-4fb0-8649-54b69e4c6fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:17.944127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e7308-1def-4fb0-8649-54b69e4c6fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:17.968487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-636e7308-1def-4fb0-8649-54b69e4c6fd8 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:17.970244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-636e7308-1def-4fb0-8649-54b69e4c6fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:18.009706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:18.028987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962a0a4-d3f7-4d94-982c-b98cc2a01875 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:18.049815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 309/625] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:18.050474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e7308-1def-4fb0-8649-54b69e4c6fd8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:18.067343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500d3e8-3143-40e1-9471-8e33e0eae8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:18.068130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500d3e8-3143-40e1-9471-8e33e0eae8fa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.068407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500d3e8-3143-40e1-9471-8e33e0eae8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.068670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500d3e8-3143-40e1-9471-8e33e0eae8fa None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.069435 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500d3e8-3143-40e1-9471-8e33e0eae8fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:18.069736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500d3e8-3143-40e1-9471-8e33e0eae8fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:18.071448 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500d3e8-3143-40e1-9471-8e33e0eae8fa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:18.085244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 317/626] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:18.092561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500d3e8-3143-40e1-9471-8e33e0eae8fa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:18.171887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:18.198142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e7308-1def-4fb0-8649-54b69e4c6fd8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:18.236564 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603ec1e-6c13-4467-8404-b9d4b46aeaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:18.237324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603ec1e-6c13-4467-8404-b9d4b46aeaf9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.237781 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603ec1e-6c13-4467-8404-b9d4b46aeaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.238126 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603ec1e-6c13-4467-8404-b9d4b46aeaf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.238967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603ec1e-6c13-4467-8404-b9d4b46aeaf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:18.239413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603ec1e-6c13-4467-8404-b9d4b46aeaf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:18.241014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603ec1e-6c13-4467-8404-b9d4b46aeaf9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:18.245420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500d3e8-3143-40e1-9471-8e33e0eae8fa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:18.259329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 310/627] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:18.261173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7094f-a2ae-4418-aebe-7273bcb0a910 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.261729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7094f-a2ae-4418-aebe-7273bcb0a910 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.262008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7094f-a2ae-4418-aebe-7273bcb0a910 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.263575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 311/628] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:18.264265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7094f-a2ae-4418-aebe-7273bcb0a910 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:18.281756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363fcae-4c9c-4755-84b2-b6bdad2e646d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:18.282573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363fcae-4c9c-4755-84b2-b6bdad2e646d None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.282957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363fcae-4c9c-4755-84b2-b6bdad2e646d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.283406 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363fcae-4c9c-4755-84b2-b6bdad2e646d None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/8834ef19c2604e8c828aa4dd32db61a7/roles/0af1ff2cf6f948529ec7cece6eca90d4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.302531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:18.303027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363fcae-4c9c-4755-84b2-b6bdad2e646d None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=8834ef19c2604e8c828aa4dd32db61a7, role_id=0af1ff2cf6f948529ec7cece6eca90d4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:18.305750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363fcae-4c9c-4755-84b2-b6bdad2e646d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:18.324672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 318/629] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:57:18 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/8834ef19c2604e8c828aa4dd32db61a7/roles/0af1ff2cf6f948529ec7cece6eca90d4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:57:18.326482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab122af7-c9d1-4e18-a94d-784b838e4853 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.326987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab122af7-c9d1-4e18-a94d-784b838e4853 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.327502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab122af7-c9d1-4e18-a94d-784b838e4853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.351190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ab122af7-c9d1-4e18-a94d-784b838e4853 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:18.353287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ab122af7-c9d1-4e18-a94d-784b838e4853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:18.398735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7094f-a2ae-4418-aebe-7273bcb0a910 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:18.442359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7fd2f-bda9-463d-897f-93a92b1b4346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:18.443081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7fd2f-bda9-463d-897f-93a92b1b4346 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.443458 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7fd2f-bda9-463d-897f-93a92b1b4346 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.443821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7fd2f-bda9-463d-897f-93a92b1b4346 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.452216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7fd2f-bda9-463d-897f-93a92b1b4346 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:18.454021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7fd2f-bda9-463d-897f-93a92b1b4346 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:18.455179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 319/630] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:18.456647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab122af7-c9d1-4e18-a94d-784b838e4853 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b5b7fd2f-bda9-463d-897f-93a92b1b4346 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:18.474908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:18.476022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:18.477623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 312/631] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Sep 19 16:57:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:18.483452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7fd2f-bda9-463d-897f-93a92b1b4346 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:18.503582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:18.605311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:18.609267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab122af7-c9d1-4e18-a94d-784b838e4853 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:18.623387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7fd2f-bda9-463d-897f-93a92b1b4346 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:18.645008 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc55a8-56a7-4b60-aa6b-d8a2832ebe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:18.645898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc55a8-56a7-4b60-aa6b-d8a2832ebe88 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.646328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc55a8-56a7-4b60-aa6b-d8a2832ebe88 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.646691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc55a8-56a7-4b60-aa6b-d8a2832ebe88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.657291 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc55a8-56a7-4b60-aa6b-d8a2832ebe88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-efdc55a8-56a7-4b60-aa6b-d8a2832ebe88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:18.662193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:18.663324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:18.664368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:18.669109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 320/632] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:18.669109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5861fde-ecd8-4364-8c63-b7c030636bbb None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.669109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5861fde-ecd8-4364-8c63-b7c030636bbb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.669109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5861fde-ecd8-4364-8c63-b7c030636bbb None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.669789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 321/633] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:18.673361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1aabfa-3c6c-4900-bbfb-a36a499cafa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:18.674424 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aabfa-3c6c-4900-bbfb-a36a499cafa9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.674874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5861fde-ecd8-4364-8c63-b7c030636bbb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:18.674998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aabfa-3c6c-4900-bbfb-a36a499cafa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.675470 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1aabfa-3c6c-4900-bbfb-a36a499cafa9 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.676361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1aabfa-3c6c-4900-bbfb-a36a499cafa9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:18.676867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1aabfa-3c6c-4900-bbfb-a36a499cafa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:18.678525 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1aabfa-3c6c-4900-bbfb-a36a499cafa9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:18.701569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 313/634] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Sep 19 16:57:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:18.703695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a0ae8-6754-4251-af27-44073d8e8849 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.704159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a0ae8-6754-4251-af27-44073d8e8849 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.704730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a0ae8-6754-4251-af27-44073d8e8849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.727106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-128a0ae8-6754-4251-af27-44073d8e8849 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:18.728812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-128a0ae8-6754-4251-af27-44073d8e8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:18.761821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:18.781671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5861fde-ecd8-4364-8c63-b7c030636bbb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:18.810211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 314/635] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:18.810211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a0ae8-6754-4251-af27-44073d8e8849 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:18.827695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09934b-a060-485e-9875-ca7efa89ff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:18.828809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09934b-a060-485e-9875-ca7efa89ff05 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.829596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09934b-a060-485e-9875-ca7efa89ff05 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.830301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09934b-a060-485e-9875-ca7efa89ff05 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.831197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09934b-a060-485e-9875-ca7efa89ff05 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:18.831804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09934b-a060-485e-9875-ca7efa89ff05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:18.834056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09934b-a060-485e-9875-ca7efa89ff05 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:18.844303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 322/636] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:18.845443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09934b-a060-485e-9875-ca7efa89ff05 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:18.892712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:18.918846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a0ae8-6754-4251-af27-44073d8e8849 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:18.963227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1ccbe-0977-4610-b151-cc7e20f068d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:18.964090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ccbe-0977-4610-b151-cc7e20f068d1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:18.964377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ccbe-0977-4610-b151-cc7e20f068d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:18.964652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1ccbe-0977-4610-b151-cc7e20f068d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:18.970951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09934b-a060-485e-9875-ca7efa89ff05 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.005404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613bee5-6d8e-4dc2-9d46-277b735ca8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:19.006364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613bee5-6d8e-4dc2-9d46-277b735ca8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:19.006818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613bee5-6d8e-4dc2-9d46-277b735ca8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:19.007276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613bee5-6d8e-4dc2-9d46-277b735ca8e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:19.017840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613bee5-6d8e-4dc2-9d46-277b735ca8e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a613bee5-6d8e-4dc2-9d46-277b735ca8e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:19.023842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:19.024766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:19.025643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:19.028132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 323/637] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:19.029262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613bee5-6d8e-4dc2-9d46-277b735ca8e4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.032380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:19.045445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1ccbe-0977-4610-b151-cc7e20f068d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:19.047025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1ccbe-0977-4610-b151-cc7e20f068d1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:19.133780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613bee5-6d8e-4dc2-9d46-277b735ca8e4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.134824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:19.164930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 315/638] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:19.165830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1ccbe-0977-4610-b151-cc7e20f068d1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.174717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d8fe4-0ed1-47b5-a61b-c013fa650759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:19.175289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d8fe4-0ed1-47b5-a61b-c013fa650759 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:19.175575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d8fe4-0ed1-47b5-a61b-c013fa650759 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:19.175904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d8fe4-0ed1-47b5-a61b-c013fa650759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:19.186643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d8fe4-0ed1-47b5-a61b-c013fa650759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:19.188093 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d8fe4-0ed1-47b5-a61b-c013fa650759 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a12d8fe4-0ed1-47b5-a61b-c013fa650759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:19.202123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:19.203053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:19.203914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:19.203914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:19.203914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:19.203914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 324/639] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:19.204233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d8fe4-0ed1-47b5-a61b-c013fa650759 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.261783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:19.278808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1ccbe-0977-4610-b151-cc7e20f068d1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.308906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d8fe4-0ed1-47b5-a61b-c013fa650759 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.314164 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1565183-85fa-4c30-8ba7-f7fdb5c1482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:19.314796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565183-85fa-4c30-8ba7-f7fdb5c1482e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:19.315077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565183-85fa-4c30-8ba7-f7fdb5c1482e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:19.315347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1565183-85fa-4c30-8ba7-f7fdb5c1482e None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:19.316033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1565183-85fa-4c30-8ba7-f7fdb5c1482e None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:19.316325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1565183-85fa-4c30-8ba7-f7fdb5c1482e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:19.317834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1565183-85fa-4c30-8ba7-f7fdb5c1482e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:19.334052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 316/640] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:19.335444 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1565183-85fa-4c30-8ba7-f7fdb5c1482e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.351214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fd862-52a0-4041-81ea-62871257aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:19.351855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fd862-52a0-4041-81ea-62871257aad6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:19.352134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fd862-52a0-4041-81ea-62871257aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:19.352403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fd862-52a0-4041-81ea-62871257aad6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:19.362447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fd862-52a0-4041-81ea-62871257aad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-141fd862-52a0-4041-81ea-62871257aad6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:19.367701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:19.368802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 325/641] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:19.374186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fd862-52a0-4041-81ea-62871257aad6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.385353 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:19.446406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1565183-85fa-4c30-8ba7-f7fdb5c1482e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.481000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87e286-6622-4ae0-bea2-646944382884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:19.481650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87e286-6622-4ae0-bea2-646944382884 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:19.481920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87e286-6622-4ae0-bea2-646944382884 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:19.482192 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87e286-6622-4ae0-bea2-646944382884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:19.486757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fd862-52a0-4041-81ea-62871257aad6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.493300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87e286-6622-4ae0-bea2-646944382884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:19.494750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87e286-6622-4ae0-bea2-646944382884 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:19.501645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-1a87e286-6622-4ae0-bea2-646944382884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:19.509047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:19.510081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:19.510982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:19.510982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:19.510982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:19.510982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 317/642] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:19.510982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87e286-6622-4ae0-bea2-646944382884 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.528129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c0713-9968-4189-9f2e-5f23595a5216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:19.528786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c0713-9968-4189-9f2e-5f23595a5216 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:19.529090 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c0713-9968-4189-9f2e-5f23595a5216 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:19.529303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c0713-9968-4189-9f2e-5f23595a5216 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:19.529946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c0713-9968-4189-9f2e-5f23595a5216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:19.530349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c0713-9968-4189-9f2e-5f23595a5216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:19.531842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c0713-9968-4189-9f2e-5f23595a5216 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:19.549305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 326/643] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:19.549305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c0713-9968-4189-9f2e-5f23595a5216 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.607635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:19.618594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87e286-6622-4ae0-bea2-646944382884 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.652634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfed6d-7878-4698-84ea-def5d6bf6f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:19.653250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c0713-9968-4189-9f2e-5f23595a5216 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.654316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfed6d-7878-4698-84ea-def5d6bf6f01 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:19.654630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfed6d-7878-4698-84ea-def5d6bf6f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:19.654899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfed6d-7878-4698-84ea-def5d6bf6f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:19.666911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfed6d-7878-4698-84ea-def5d6bf6f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:19.668363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfed6d-7878-4698-84ea-def5d6bf6f01 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-e1dfed6d-7878-4698-84ea-def5d6bf6f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:19.683524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:19.684656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:19.685940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:19.685940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:19.685940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:19.685940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 318/644] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:19.685940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfed6d-7878-4698-84ea-def5d6bf6f01 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.699587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c53ce-3b98-4e95-9c29-764e7e336aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:19.700132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c53ce-3b98-4e95-9c29-764e7e336aba None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:19.700658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c53ce-3b98-4e95-9c29-764e7e336aba None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:19.700926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c53ce-3b98-4e95-9c29-764e7e336aba None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:19.702166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c53ce-3b98-4e95-9c29-764e7e336aba None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:19.702472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c53ce-3b98-4e95-9c29-764e7e336aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:19.703843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c53ce-3b98-4e95-9c29-764e7e336aba None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:19.712075 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 327/645] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:19.712863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c53ce-3b98-4e95-9c29-764e7e336aba None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.748852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:19.799638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfed6d-7878-4698-84ea-def5d6bf6f01 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.818558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c53ce-3b98-4e95-9c29-764e7e336aba None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.834888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f65d2-8b4b-44a5-9f85-7340eebbac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:19.835749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f65d2-8b4b-44a5-9f85-7340eebbac6d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:19.836051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f65d2-8b4b-44a5-9f85-7340eebbac6d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:19.836324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f65d2-8b4b-44a5-9f85-7340eebbac6d None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:19.836962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f65d2-8b4b-44a5-9f85-7340eebbac6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:19.837303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f65d2-8b4b-44a5-9f85-7340eebbac6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:19.839092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f65d2-8b4b-44a5-9f85-7340eebbac6d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:19.851747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 319/646] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:19.852626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f65d2-8b4b-44a5-9f85-7340eebbac6d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.857311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee020397-b5d8-4fa6-ab4b-21a3a8435044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:19.857624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:19.858424 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020397-b5d8-4fa6-ab4b-21a3a8435044 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:19.858534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020397-b5d8-4fa6-ab4b-21a3a8435044 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:19.858956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020397-b5d8-4fa6-ab4b-21a3a8435044 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:19.867039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee020397-b5d8-4fa6-ab4b-21a3a8435044 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:19.868500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee020397-b5d8-4fa6-ab4b-21a3a8435044 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ee020397-b5d8-4fa6-ab4b-21a3a8435044 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:19.880001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:19.881117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 328/647] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:19.882247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee020397-b5d8-4fa6-ab4b-21a3a8435044 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:19.970059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f65d2-8b4b-44a5-9f85-7340eebbac6d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:19.984050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:19.990497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee020397-b5d8-4fa6-ab4b-21a3a8435044 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.007258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdd603-93d5-4028-b353-20730a4a3cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.007870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdd603-93d5-4028-b353-20730a4a3cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.008146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdd603-93d5-4028-b353-20730a4a3cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.008417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdd603-93d5-4028-b353-20730a4a3cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.009065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdd603-93d5-4028-b353-20730a4a3cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:20.009377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdd603-93d5-4028-b353-20730a4a3cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.010737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdd603-93d5-4028-b353-20730a4a3cd1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.022891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 320/648] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:20.023435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdd603-93d5-4028-b353-20730a4a3cd1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.030494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a0fe-1dd2-46cb-834a-515ddca09e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.031141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a0fe-1dd2-46cb-834a-515ddca09e13 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.031423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a0fe-1dd2-46cb-834a-515ddca09e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.031695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2a0fe-1dd2-46cb-834a-515ddca09e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.043009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2a0fe-1dd2-46cb-834a-515ddca09e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.044470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2a0fe-1dd2-46cb-834a-515ddca09e13 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f9a2a0fe-1dd2-46cb-834a-515ddca09e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:20.059141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:20.060293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:20.061412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:20.061412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:20.061412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:20.067568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 329/649] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:20.067568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a0fe-1dd2-46cb-834a-515ddca09e13 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.090917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:20.129092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdd603-93d5-4028-b353-20730a4a3cd1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.167711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea070531-e47e-47e5-ba5e-5c77a7ba7ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.168345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea070531-e47e-47e5-ba5e-5c77a7ba7ffa None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.168617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea070531-e47e-47e5-ba5e-5c77a7ba7ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.168881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea070531-e47e-47e5-ba5e-5c77a7ba7ffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.175345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2a0fe-1dd2-46cb-834a-515ddca09e13 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.175472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea070531-e47e-47e5-ba5e-5c77a7ba7ffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.176932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea070531-e47e-47e5-ba5e-5c77a7ba7ffa None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ea070531-e47e-47e5-ba5e-5c77a7ba7ffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:20.188404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:20.189523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:20.190752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:20.190752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:20.190752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:20.190752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:20.190752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:20.190752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:20.190752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:20.190752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:20.194531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 321/650] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:20.195175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea070531-e47e-47e5-ba5e-5c77a7ba7ffa None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.215292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eb9f6-df18-4227-bae1-1ee45655ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.216156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eb9f6-df18-4227-bae1-1ee45655ce99 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.216444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eb9f6-df18-4227-bae1-1ee45655ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.216719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eb9f6-df18-4227-bae1-1ee45655ce99 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.217513 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eb9f6-df18-4227-bae1-1ee45655ce99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:20.217821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eb9f6-df18-4227-bae1-1ee45655ce99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.219265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eb9f6-df18-4227-bae1-1ee45655ce99 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.240669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 330/651] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:20.241887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eb9f6-df18-4227-bae1-1ee45655ce99 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.254182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:20.299972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea070531-e47e-47e5-ba5e-5c77a7ba7ffa None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.327111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:20.340516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ed8f3-e95b-4189-9eff-8f875ccab143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.341755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed8f3-e95b-4189-9eff-8f875ccab143 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.342140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed8f3-e95b-4189-9eff-8f875ccab143 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.342665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed8f3-e95b-4189-9eff-8f875ccab143 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.351368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed8f3-e95b-4189-9eff-8f875ccab143 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.352854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed8f3-e95b-4189-9eff-8f875ccab143 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.354294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eb9f6-df18-4227-bae1-1ee45655ce99 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-fd5ed8f3-e95b-4189-9eff-8f875ccab143 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:20.364159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:20.365373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:20.366506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 322/652] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:20.367143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ed8f3-e95b-4189-9eff-8f875ccab143 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.395611 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ae498-5930-4e93-b02d-a379da9cf9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.396237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae498-5930-4e93-b02d-a379da9cf9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.396516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae498-5930-4e93-b02d-a379da9cf9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.396788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ae498-5930-4e93-b02d-a379da9cf9e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.397467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ae498-5930-4e93-b02d-a379da9cf9e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:20.397770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ae498-5930-4e93-b02d-a379da9cf9e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.399158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ae498-5930-4e93-b02d-a379da9cf9e3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.411216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 331/653] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:20.412033 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ae498-5930-4e93-b02d-a379da9cf9e3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.475465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ed8f3-e95b-4189-9eff-8f875ccab143 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.480117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:20.513678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1609428-0b86-4de1-8da5-9e8c1e842805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.514201 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1609428-0b86-4de1-8da5-9e8c1e842805 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.514487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1609428-0b86-4de1-8da5-9e8c1e842805 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.514751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1609428-0b86-4de1-8da5-9e8c1e842805 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.515439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1609428-0b86-4de1-8da5-9e8c1e842805 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:20.515744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1609428-0b86-4de1-8da5-9e8c1e842805 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.517195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1609428-0b86-4de1-8da5-9e8c1e842805 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.518704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ae498-5930-4e93-b02d-a379da9cf9e3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.529479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 323/654] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:20.530284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1609428-0b86-4de1-8da5-9e8c1e842805 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.560222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9563-8908-491c-8595-34954f3c1859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.560954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9563-8908-491c-8595-34954f3c1859 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.561195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9563-8908-491c-8595-34954f3c1859 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.561434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9563-8908-491c-8595-34954f3c1859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.579207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:20.630051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca9563-8908-491c-8595-34954f3c1859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.631511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca9563-8908-491c-8595-34954f3c1859 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.633834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1609428-0b86-4de1-8da5-9e8c1e842805 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.669123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceb801-fc3e-4163-bada-e6f1d3182cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.669744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb801-fc3e-4163-bada-e6f1d3182cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.670028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb801-fc3e-4163-bada-e6f1d3182cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.670301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb801-fc3e-4163-bada-e6f1d3182cb7 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.671030 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceb801-fc3e-4163-bada-e6f1d3182cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:20.671362 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceb801-fc3e-4163-bada-e6f1d3182cb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.672785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceb801-fc3e-4163-bada-e6f1d3182cb7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.689576 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 324/655] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:20.690367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceb801-fc3e-4163-bada-e6f1d3182cb7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.691693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:20.726303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 332/656] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:20.727128 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9563-8908-491c-8595-34954f3c1859 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.788154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceb801-fc3e-4163-bada-e6f1d3182cb7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.789766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:20.823113 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb045a-985f-4623-9898-6b93b61a153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.823742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb045a-985f-4623-9898-6b93b61a153b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.824056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb045a-985f-4623-9898-6b93b61a153b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.824327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb045a-985f-4623-9898-6b93b61a153b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.825129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9563-8908-491c-8595-34954f3c1859 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.831251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb045a-985f-4623-9898-6b93b61a153b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.832701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb045a-985f-4623-9898-6b93b61a153b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-4cbb045a-985f-4623-9898-6b93b61a153b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:20.844391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:20.845479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:20.846621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:20.846621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:20.846621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:20.846621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:20.846621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:20.846621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:20.846621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:20.846621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:20.846621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 16:57:20.846621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:20.849182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 325/657] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:20.850625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a113-242b-4e86-a194-eb7893426004 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.850907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a113-242b-4e86-a194-eb7893426004 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.851187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29a113-242b-4e86-a194-eb7893426004 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.852450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 326/658] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:20.853163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29a113-242b-4e86-a194-eb7893426004 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.861673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a512-4993-48ec-89e4-5c0ee80cd44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:20.862396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a512-4993-48ec-89e4-5c0ee80cd44a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:20.862676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a512-4993-48ec-89e4-5c0ee80cd44a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:20.862949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a512-4993-48ec-89e4-5c0ee80cd44a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:20.863687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9a512-4993-48ec-89e4-5c0ee80cd44a None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=ea18c782ddf2469fa3d10a135fc34c37) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:20.864000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9a512-4993-48ec-89e4-5c0ee80cd44a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:20.865637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9a512-4993-48ec-89e4-5c0ee80cd44a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:20.877837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 333/659] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/role_assignments?user.id=ea18c782ddf2469fa3d10a135fc34c37&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:20.877837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a512-4993-48ec-89e4-5c0ee80cd44a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:20.905707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:20.977412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29a113-242b-4e86-a194-eb7893426004 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:20.983262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a512-4993-48ec-89e4-5c0ee80cd44a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:21.016891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193c024-2029-496f-9561-e1772958155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:21.017570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193c024-2029-496f-9561-e1772958155d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:21.017832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193c024-2029-496f-9561-e1772958155d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:21.018106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193c024-2029-496f-9561-e1772958155d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:21.021120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bbd0f-73ae-4da1-9552-f40e6ecadeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:21.021799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bbd0f-73ae-4da1-9552-f40e6ecadeee None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:21.022077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bbd0f-73ae-4da1-9552-f40e6ecadeee None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:21.022349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bbd0f-73ae-4da1-9552-f40e6ecadeee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:21.034880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bbd0f-73ae-4da1-9552-f40e6ecadeee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:21.036410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bbd0f-73ae-4da1-9552-f40e6ecadeee None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-394bbd0f-73ae-4da1-9552-f40e6ecadeee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:21.052141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:21.053242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:21.054114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:21.054114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:21.054114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:21.054290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:21.056239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 334/660] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:21.057628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bbd0f-73ae-4da1-9552-f40e6ecadeee None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:21.107286 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193c024-2029-496f-9561-e1772958155d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:21.108765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193c024-2029-496f-9561-e1772958155d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:21.155442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:21.175668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bbd0f-73ae-4da1-9552-f40e6ecadeee None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:21.210408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea64b-40d4-4894-9011-e30e314abb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:21.211025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea64b-40d4-4894-9011-e30e314abb6f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:21.211303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea64b-40d4-4894-9011-e30e314abb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:21.211569 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ea64b-40d4-4894-9011-e30e314abb6f None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:21.212305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ea64b-40d4-4894-9011-e30e314abb6f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:21.212609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ea64b-40d4-4894-9011-e30e314abb6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:21.214135 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ea64b-40d4-4894-9011-e30e314abb6f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:21.217504 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 327/661] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:21.218914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374882-fb2f-404a-8d09-c52c62c5e47c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:21.219360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374882-fb2f-404a-8d09-c52c62c5e47c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:21.219767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374882-fb2f-404a-8d09-c52c62c5e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:21.233444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 335/662] 10.222.0.76 () {56 vars in 1139 bytes} [Mon Sep 19 16:57:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:21.234274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea64b-40d4-4894-9011-e30e314abb6f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:21.242306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6e374882-fb2f-404a-8d09-c52c62c5e47c None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:21.243492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6e374882-fb2f-404a-8d09-c52c62c5e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:21.311346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:21.329082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 328/663] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:21.329082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e374882-fb2f-404a-8d09-c52c62c5e47c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:21.342380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ea64b-40d4-4894-9011-e30e314abb6f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:21.380568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cdabc-e3b5-4add-bbaa-e24c7a3d137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:21.381324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cdabc-e3b5-4add-bbaa-e24c7a3d137e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:21.381696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cdabc-e3b5-4add-bbaa-e24c7a3d137e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:21.382038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cdabc-e3b5-4add-bbaa-e24c7a3d137e None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:21.382804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cdabc-e3b5-4add-bbaa-e24c7a3d137e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:21.383173 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cdabc-e3b5-4add-bbaa-e24c7a3d137e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:21.384624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cdabc-e3b5-4add-bbaa-e24c7a3d137e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:21.394157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:21.398521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 336/664] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:21.402640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cdabc-e3b5-4add-bbaa-e24c7a3d137e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:21.470388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e374882-fb2f-404a-8d09-c52c62c5e47c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:21.509863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eca4ad-2ee9-4255-aa1a-12ad41e509b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:21.510950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eca4ad-2ee9-4255-aa1a-12ad41e509b0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:21.511407 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eca4ad-2ee9-4255-aa1a-12ad41e509b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:21.512236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eca4ad-2ee9-4255-aa1a-12ad41e509b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:21.524063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eca4ad-2ee9-4255-aa1a-12ad41e509b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:21.525666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eca4ad-2ee9-4255-aa1a-12ad41e509b0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:21.540834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cdabc-e3b5-4add-bbaa-e24c7a3d137e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-17eca4ad-2ee9-4255-aa1a-12ad41e509b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:21.543553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:21.544939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:21.546317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:21.546317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:21.546317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:21.549596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 329/665] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:21.550594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eca4ad-2ee9-4255-aa1a-12ad41e509b0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:21.588623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead88136-d72b-4af4-a77f-12a1903512c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:21.590941 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead88136-d72b-4af4-a77f-12a1903512c2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:21.591432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead88136-d72b-4af4-a77f-12a1903512c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:21.591874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead88136-d72b-4af4-a77f-12a1903512c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:21.603685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:21.670621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:21.671747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eca4ad-2ee9-4255-aa1a-12ad41e509b0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:21.676829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead88136-d72b-4af4-a77f-12a1903512c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:21.678496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead88136-d72b-4af4-a77f-12a1903512c2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:21.709212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2847e-e887-4bed-bd26-b2ba0cd18596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:21.709940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2847e-e887-4bed-bd26-b2ba0cd18596 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:21.710295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2847e-e887-4bed-bd26-b2ba0cd18596 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:21.710565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2847e-e887-4bed-bd26-b2ba0cd18596 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:21.718333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2847e-e887-4bed-bd26-b2ba0cd18596 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:21.719933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2847e-e887-4bed-bd26-b2ba0cd18596 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-96c2847e-e887-4bed-bd26-b2ba0cd18596 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:21.732234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:21.733186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:21.734049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:21.734049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:21.734049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:21.734049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:21.734049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:21.734049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:21.734049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:21.734049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:21.734049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 330/666] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:21.734522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2847e-e887-4bed-bd26-b2ba0cd18596 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:21.788616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 337/667] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:21.789538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead88136-d72b-4af4-a77f-12a1903512c2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:21.844674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2847e-e887-4bed-bd26-b2ba0cd18596 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:21.846897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:21.881943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5867e95-75a0-40cf-8108-a5948cc44ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:21.882557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5867e95-75a0-40cf-8108-a5948cc44ebc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:21.883024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5867e95-75a0-40cf-8108-a5948cc44ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:21.883144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5867e95-75a0-40cf-8108-a5948cc44ebc None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:21.883736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5867e95-75a0-40cf-8108-a5948cc44ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:21.884038 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5867e95-75a0-40cf-8108-a5948cc44ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:21.885763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5867e95-75a0-40cf-8108-a5948cc44ebc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:21.907162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 331/668] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:21.907162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5867e95-75a0-40cf-8108-a5948cc44ebc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:21.908970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:21.912652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead88136-d72b-4af4-a77f-12a1903512c2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:21.947871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f343-eb64-46c7-a4a2-c5d94a0e3561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:21.948743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f343-eb64-46c7-a4a2-c5d94a0e3561 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:21.949019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f343-eb64-46c7-a4a2-c5d94a0e3561 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:21.949317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88f343-eb64-46c7-a4a2-c5d94a0e3561 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:21.962457 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88f343-eb64-46c7-a4a2-c5d94a0e3561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0e88f343-eb64-46c7-a4a2-c5d94a0e3561 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:21.968012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:21.968961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:21.969884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:21.974182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 338/669] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:21.974998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f343-eb64-46c7-a4a2-c5d94a0e3561 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.010882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5867e95-75a0-40cf-8108-a5948cc44ebc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:22.047641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab7e9e-c9f5-463a-93bf-78600264130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:22.048641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab7e9e-c9f5-463a-93bf-78600264130c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:22.049173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab7e9e-c9f5-463a-93bf-78600264130c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:22.049675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab7e9e-c9f5-463a-93bf-78600264130c None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:22.050629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab7e9e-c9f5-463a-93bf-78600264130c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:22.051029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab7e9e-c9f5-463a-93bf-78600264130c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:22.052492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab7e9e-c9f5-463a-93bf-78600264130c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:22.064909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 332/670] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:22.065756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab7e9e-c9f5-463a-93bf-78600264130c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.092029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88f343-eb64-46c7-a4a2-c5d94a0e3561 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:22.098357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:22.127615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d429a5d-97b0-465c-a280-38666104bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:22.128246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d429a5d-97b0-465c-a280-38666104bc34 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:22.128525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d429a5d-97b0-465c-a280-38666104bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:22.128800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d429a5d-97b0-465c-a280-38666104bc34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:22.140141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d429a5d-97b0-465c-a280-38666104bc34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:22.141687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d429a5d-97b0-465c-a280-38666104bc34 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7d429a5d-97b0-465c-a280-38666104bc34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:22.163975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:22.165228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:22.167108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:22.167108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:22.167108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:22.168557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 339/671] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:22.169071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d429a5d-97b0-465c-a280-38666104bc34 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.191824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:22.199489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab7e9e-c9f5-463a-93bf-78600264130c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:22.235072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609f24d-71e5-4dab-8d09-99776d8e1d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:22.235709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609f24d-71e5-4dab-8d09-99776d8e1d4c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:22.236020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609f24d-71e5-4dab-8d09-99776d8e1d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:22.236256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609f24d-71e5-4dab-8d09-99776d8e1d4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:22.245796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609f24d-71e5-4dab-8d09-99776d8e1d4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:22.247248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609f24d-71e5-4dab-8d09-99776d8e1d4c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a609f24d-71e5-4dab-8d09-99776d8e1d4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:22.258904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:22.259804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:22.265529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:22.265529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:22.265529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:22.265529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:22.265529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:22.265529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:22.265529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:22.265529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:22.265529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 333/672] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:22.265529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609f24d-71e5-4dab-8d09-99776d8e1d4c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.291583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d429a5d-97b0-465c-a280-38666104bc34 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:22.327422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a314102-e86b-466d-8b82-3f1f45b18a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:22.328033 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a314102-e86b-466d-8b82-3f1f45b18a31 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:22.328310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a314102-e86b-466d-8b82-3f1f45b18a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:22.328585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a314102-e86b-466d-8b82-3f1f45b18a31 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:22.329281 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a314102-e86b-466d-8b82-3f1f45b18a31 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:22.329584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a314102-e86b-466d-8b82-3f1f45b18a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:22.331007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a314102-e86b-466d-8b82-3f1f45b18a31 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:22.338946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 340/673] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:22.339725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a314102-e86b-466d-8b82-3f1f45b18a31 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.362870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:22.382162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609f24d-71e5-4dab-8d09-99776d8e1d4c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:22.417055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaafc9-720b-430c-83a3-4b754c6b4115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:22.417774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaafc9-720b-430c-83a3-4b754c6b4115 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:22.418053 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaafc9-720b-430c-83a3-4b754c6b4115 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:22.418347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaafc9-720b-430c-83a3-4b754c6b4115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:22.419178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:22.419288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaafc9-720b-430c-83a3-4b754c6b4115 None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=2c746178628e4df5961982268e642ff7) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:22.419672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaafc9-720b-430c-83a3-4b754c6b4115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:22.421925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaafc9-720b-430c-83a3-4b754c6b4115 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:22.430811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 334/674] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:22 2022] GET /identity/v3/role_assignments?user.id=2c746178628e4df5961982268e642ff7&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:22.442118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaafc9-720b-430c-83a3-4b754c6b4115 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.446596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a314102-e86b-466d-8b82-3f1f45b18a31 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:22.484074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9b4b4-daa8-497d-9bd4-917f3d1b1fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:22.484724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9b4b4-daa8-497d-9bd4-917f3d1b1fdc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:22.485001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9b4b4-daa8-497d-9bd4-917f3d1b1fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:22.485296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9b4b4-daa8-497d-9bd4-917f3d1b1fdc None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:22.485951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9b4b4-daa8-497d-9bd4-917f3d1b1fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:22.486252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9b4b4-daa8-497d-9bd4-917f3d1b1fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:22.487637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9b4b4-daa8-497d-9bd4-917f3d1b1fdc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:22.505959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 341/675] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:22.506976 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9b4b4-daa8-497d-9bd4-917f3d1b1fdc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.596195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaafc9-720b-430c-83a3-4b754c6b4115 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:22.616589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9b4b4-daa8-497d-9bd4-917f3d1b1fdc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:22.648029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7981c8-6af4-4064-8ed4-799f63310677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:22.648656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7981c8-6af4-4064-8ed4-799f63310677 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:22.648932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7981c8-6af4-4064-8ed4-799f63310677 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:22.649283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7981c8-6af4-4064-8ed4-799f63310677 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:22.650062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7981c8-6af4-4064-8ed4-799f63310677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:22.650278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7981c8-6af4-4064-8ed4-799f63310677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:22.651709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7981c8-6af4-4064-8ed4-799f63310677 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:22.660218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f3bf3-1444-45a2-ab8c-dc2c5c333902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:22.660868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3bf3-1444-45a2-ab8c-dc2c5c333902 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:22.661230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3bf3-1444-45a2-ab8c-dc2c5c333902 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:22.661502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f3bf3-1444-45a2-ab8c-dc2c5c333902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:22.663886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:22.665108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 335/676] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:22.671171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7981c8-6af4-4064-8ed4-799f63310677 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.675349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f3bf3-1444-45a2-ab8c-dc2c5c333902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:22.676932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f3bf3-1444-45a2-ab8c-dc2c5c333902 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:22.683915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-196f3bf3-1444-45a2-ab8c-dc2c5c333902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:22.692453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:22.693678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:22.694546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:22.694546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:22.694546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:22.694546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 342/677] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:22.694764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f3bf3-1444-45a2-ab8c-dc2c5c333902 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.795490 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7981c8-6af4-4064-8ed4-799f63310677 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:22.829122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f3bf3-1444-45a2-ab8c-dc2c5c333902 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:22.832809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c487925-3f38-4ff3-a1d9-831a1234fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:22.833511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c487925-3f38-4ff3-a1d9-831a1234fa92 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:22.833797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c487925-3f38-4ff3-a1d9-831a1234fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:22.834075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c487925-3f38-4ff3-a1d9-831a1234fa92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:22.841269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c487925-3f38-4ff3-a1d9-831a1234fa92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:22.842719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c487925-3f38-4ff3-a1d9-831a1234fa92 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6c487925-3f38-4ff3-a1d9-831a1234fa92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:22.854399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:22.855322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:22.856187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:22.856187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:22.856187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:22.856187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:22.856187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:22.856187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:22.856187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:22.856187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:22.856187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 336/678] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:22.856664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c487925-3f38-4ff3-a1d9-831a1234fa92 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.872086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096a6ec-db42-4db1-b34a-0a060fb7df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:22.873513 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096a6ec-db42-4db1-b34a-0a060fb7df43 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:22.874969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096a6ec-db42-4db1-b34a-0a060fb7df43 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:22.875243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096a6ec-db42-4db1-b34a-0a060fb7df43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:22.876001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096a6ec-db42-4db1-b34a-0a060fb7df43 None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=7338fa9ff18c42f8bc26710ab8376b3f) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:22.876304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096a6ec-db42-4db1-b34a-0a060fb7df43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:22.880250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096a6ec-db42-4db1-b34a-0a060fb7df43 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:22.893056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 343/679] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:22 2022] GET /identity/v3/role_assignments?user.id=7338fa9ff18c42f8bc26710ab8376b3f&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:22.893056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096a6ec-db42-4db1-b34a-0a060fb7df43 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:22.971859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:23.010175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:23.072224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096a6ec-db42-4db1-b34a-0a060fb7df43 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:23.089163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c487925-3f38-4ff3-a1d9-831a1234fa92 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:23.120862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91ffcf-9723-4105-a6cb-8b619fdab17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:23.121562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91ffcf-9723-4105-a6cb-8b619fdab17a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:23.121842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91ffcf-9723-4105-a6cb-8b619fdab17a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:23.122167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91ffcf-9723-4105-a6cb-8b619fdab17a None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:23.122847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91ffcf-9723-4105-a6cb-8b619fdab17a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:23.123180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91ffcf-9723-4105-a6cb-8b619fdab17a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:23.125002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91ffcf-9723-4105-a6cb-8b619fdab17a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:23.149994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 344/680] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:23.151319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655621e-c48c-4b6f-b66d-e967c879a552 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:23.151606 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655621e-c48c-4b6f-b66d-e967c879a552 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:23.151905 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655621e-c48c-4b6f-b66d-e967c879a552 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:23.157070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 345/681] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:23.160954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd0b74-8983-4dca-8f9e-24fc36a20be6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:23.161274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd0b74-8983-4dca-8f9e-24fc36a20be6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:23.161551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd0b74-8983-4dca-8f9e-24fc36a20be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:23.168637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2662218-11d8-49ac-ab92-31e7c90c0e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:23.169917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662218-11d8-49ac-ab92-31e7c90c0e9a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:23.169917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662218-11d8-49ac-ab92-31e7c90c0e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:23.169917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662218-11d8-49ac-ab92-31e7c90c0e9a None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:23.170508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2662218-11d8-49ac-ab92-31e7c90c0e9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:23.170815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2662218-11d8-49ac-ab92-31e7c90c0e9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:23.172205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2662218-11d8-49ac-ab92-31e7c90c0e9a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:23.182858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-81bd0b74-8983-4dca-8f9e-24fc36a20be6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:23.184072 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-81bd0b74-8983-4dca-8f9e-24fc36a20be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:23.189393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 337/682] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:23.190448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2662218-11d8-49ac-ab92-31e7c90c0e9a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:23.262745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 346/683] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:23.264226 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd0b74-8983-4dca-8f9e-24fc36a20be6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:23.303510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2662218-11d8-49ac-ab92-31e7c90c0e9a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:23.314171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:23.331331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:23.340372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dee18-0a11-4458-899b-60c6a04f4739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:23.340996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dee18-0a11-4458-899b-60c6a04f4739 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:23.341308 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dee18-0a11-4458-899b-60c6a04f4739 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:23.341582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dee18-0a11-4458-899b-60c6a04f4739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:23.342320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dee18-0a11-4458-899b-60c6a04f4739 None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=da4a83dd0cb64e219bc16f8cf0b0af57) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:23.342632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dee18-0a11-4458-899b-60c6a04f4739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:23.344072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dee18-0a11-4458-899b-60c6a04f4739 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:23.350338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 338/684] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:23 2022] GET /identity/v3/role_assignments?user.id=da4a83dd0cb64e219bc16f8cf0b0af57&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:23.377726 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd0b74-8983-4dca-8f9e-24fc36a20be6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:23.433893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61674a3f-a716-4b05-b356-a0fec3115196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:23.434602 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61674a3f-a716-4b05-b356-a0fec3115196 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:23.434881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61674a3f-a716-4b05-b356-a0fec3115196 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:23.435153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61674a3f-a716-4b05-b356-a0fec3115196 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:23.449228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61674a3f-a716-4b05-b356-a0fec3115196 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:23.450800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61674a3f-a716-4b05-b356-a0fec3115196 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-61674a3f-a716-4b05-b356-a0fec3115196 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:23.468802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:23.469822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:23.470740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 347/685] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:23.477901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dee18-0a11-4458-899b-60c6a04f4739 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:23.588510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61674a3f-a716-4b05-b356-a0fec3115196 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:23.617055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dee18-0a11-4458-899b-60c6a04f4739 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:23.670180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b104-71ad-43e1-8250-b6445479c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:23.670735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b104-71ad-43e1-8250-b6445479c2db None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:23.671016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b104-71ad-43e1-8250-b6445479c2db None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:23.671283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b104-71ad-43e1-8250-b6445479c2db None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:23.672325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7b104-71ad-43e1-8250-b6445479c2db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:23.672629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7b104-71ad-43e1-8250-b6445479c2db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:23.674105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7b104-71ad-43e1-8250-b6445479c2db None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:23.696551 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 339/686] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Sep 19 16:57:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:23.704345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b104-71ad-43e1-8250-b6445479c2db None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:23.761563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:23.766100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61674a3f-a716-4b05-b356-a0fec3115196 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:23.767047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:23.812656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a1f8e-c261-4517-9f2e-a299e73315ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:23.814239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a1f8e-c261-4517-9f2e-a299e73315ea None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:23.815004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a1f8e-c261-4517-9f2e-a299e73315ea None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:23.815492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a1f8e-c261-4517-9f2e-a299e73315ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:23.827844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b104-71ad-43e1-8250-b6445479c2db None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:23.830201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a1f8e-c261-4517-9f2e-a299e73315ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9f5a1f8e-c261-4517-9f2e-a299e73315ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:23.839176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:23.840165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:23.840985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:23.844679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 348/687] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:23.850673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a1f8e-c261-4517-9f2e-a299e73315ea None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:23.889880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff248b20-6b61-455c-9b6f-c5c806e4b086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:23.890937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff248b20-6b61-455c-9b6f-c5c806e4b086 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:23.891399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff248b20-6b61-455c-9b6f-c5c806e4b086 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:23.891848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff248b20-6b61-455c-9b6f-c5c806e4b086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:23.974480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff248b20-6b61-455c-9b6f-c5c806e4b086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:23.977027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff248b20-6b61-455c-9b6f-c5c806e4b086 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:24.014470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a1f8e-c261-4517-9f2e-a299e73315ea None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:24.035543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:24.049264 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6cac8-566a-4ec9-ac29-0590941d684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:24.050037 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6cac8-566a-4ec9-ac29-0590941d684b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:24.050416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6cac8-566a-4ec9-ac29-0590941d684b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:24.050781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6cac8-566a-4ec9-ac29-0590941d684b None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:24.051633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6cac8-566a-4ec9-ac29-0590941d684b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:24.052034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6cac8-566a-4ec9-ac29-0590941d684b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:24.053566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6cac8-566a-4ec9-ac29-0590941d684b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:24.062787 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 349/688] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:24.068810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6cac8-566a-4ec9-ac29-0590941d684b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:24.088681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 340/689] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:24.104106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff248b20-6b61-455c-9b6f-c5c806e4b086 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:24.121425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:24.244175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff248b20-6b61-455c-9b6f-c5c806e4b086 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:24.269343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6cac8-566a-4ec9-ac29-0590941d684b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:24.316043 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b3241-adab-4749-93b7-406ff1ccdb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:24.317051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b3241-adab-4749-93b7-406ff1ccdb65 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:24.317660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b3241-adab-4749-93b7-406ff1ccdb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:24.318079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b3241-adab-4749-93b7-406ff1ccdb65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:24.338697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e40321-cee7-46b5-a576-beb186741f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:24.339337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e40321-cee7-46b5-a576-beb186741f64 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:24.339619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e40321-cee7-46b5-a576-beb186741f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:24.340605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b3241-adab-4749-93b7-406ff1ccdb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:24.342086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b3241-adab-4749-93b7-406ff1ccdb65 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:24.342449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e40321-cee7-46b5-a576-beb186741f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:24.363069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e40321-cee7-46b5-a576-beb186741f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:24.364642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e40321-cee7-46b5-a576-beb186741f64 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-952b3241-adab-4749-93b7-406ff1ccdb65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:24.376066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:24.377229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:24.378633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:24.378633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:24.378633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:24.378633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 341/690] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:24.382953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b3241-adab-4749-93b7-406ff1ccdb65 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:24.393369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-96e40321-cee7-46b5-a576-beb186741f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:24.397643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:24.398693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:24.399716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:24.399716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:24.399716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:24.401442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 350/691] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:24.407164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e40321-cee7-46b5-a576-beb186741f64 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:24.513901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b3241-adab-4749-93b7-406ff1ccdb65 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:24.523174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:24.557069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d926-5518-45f3-b38f-ebc3d33bc303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:24.557069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d926-5518-45f3-b38f-ebc3d33bc303 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:24.557069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d926-5518-45f3-b38f-ebc3d33bc303 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:24.557069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d926-5518-45f3-b38f-ebc3d33bc303 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:24.557525 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009d926-5518-45f3-b38f-ebc3d33bc303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:24.557525 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009d926-5518-45f3-b38f-ebc3d33bc303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:24.561055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009d926-5518-45f3-b38f-ebc3d33bc303 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:24.570012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e40321-cee7-46b5-a576-beb186741f64 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:24.575790 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 342/692] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:24.580549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d926-5518-45f3-b38f-ebc3d33bc303 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:24.614094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c884dd-633c-436f-b449-0b5fd86b63d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:24.614676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c884dd-633c-436f-b449-0b5fd86b63d4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:24.614959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c884dd-633c-436f-b449-0b5fd86b63d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:24.615234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c884dd-633c-436f-b449-0b5fd86b63d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:24.615945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c884dd-633c-436f-b449-0b5fd86b63d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:24.616252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c884dd-633c-436f-b449-0b5fd86b63d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:24.617660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c884dd-633c-436f-b449-0b5fd86b63d4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:24.631770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 351/693] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:24.636853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c884dd-633c-436f-b449-0b5fd86b63d4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:24.755773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:24.768783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c884dd-633c-436f-b449-0b5fd86b63d4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:24.835671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b78bf-c323-4dd8-bd6b-bb0d04b67092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:24.836322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b78bf-c323-4dd8-bd6b-bb0d04b67092 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:24.836599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b78bf-c323-4dd8-bd6b-bb0d04b67092 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:24.836865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b78bf-c323-4dd8-bd6b-bb0d04b67092 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:24.839528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d926-5518-45f3-b38f-ebc3d33bc303 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:24.842736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:24.856690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b78bf-c323-4dd8-bd6b-bb0d04b67092 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:24.858250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b78bf-c323-4dd8-bd6b-bb0d04b67092 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3d3b78bf-c323-4dd8-bd6b-bb0d04b67092 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:24.876710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:24.877755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:24.878695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:24.878695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:24.878695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:24.878695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:24.878695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:24.878695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:24.878695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:24.878695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:24.878695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:24.878695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:24.880175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 352/694] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Sep 19 16:57:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:24.886077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b78bf-c323-4dd8-bd6b-bb0d04b67092 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:24.951558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67881-b0ca-460b-98f5-0023bd3b1dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:24.952203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67881-b0ca-460b-98f5-0023bd3b1dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:24.952534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67881-b0ca-460b-98f5-0023bd3b1dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:24.952812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67881-b0ca-460b-98f5-0023bd3b1dd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:24.970491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc67881-b0ca-460b-98f5-0023bd3b1dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:24.972063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc67881-b0ca-460b-98f5-0023bd3b1dd8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-1bc67881-b0ca-460b-98f5-0023bd3b1dd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:24.993742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:24.994757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:24.997404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:24.997404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:24.997404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:24.997404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:24.997404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:24.997404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:24.997404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:24.997404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:24.997404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 343/695] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:25.002370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67881-b0ca-460b-98f5-0023bd3b1dd8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:25.076553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b78bf-c323-4dd8-bd6b-bb0d04b67092 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:25.152954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42881229-1188-4671-b5b0-650c327bc404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:25.153646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881229-1188-4671-b5b0-650c327bc404 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:25.153929 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881229-1188-4671-b5b0-650c327bc404 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:25.154208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881229-1188-4671-b5b0-650c327bc404 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:25.154971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42881229-1188-4671-b5b0-650c327bc404 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:25.155278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42881229-1188-4671-b5b0-650c327bc404 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:25.156731 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42881229-1188-4671-b5b0-650c327bc404 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:25.186554 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 353/696] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Sep 19 16:57:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:25.187946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e2e11-dcb1-4913-9641-60105d5d5a5b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:25.188231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e2e11-dcb1-4913-9641-60105d5d5a5b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:25.188501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e2e11-dcb1-4913-9641-60105d5d5a5b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:25.194122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 354/697] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:25.195287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e2e11-dcb1-4913-9641-60105d5d5a5b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:25.196562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67881-b0ca-460b-98f5-0023bd3b1dd8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:25.228452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:25.244403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646b692-6c12-4b09-b033-5e5f6f91e603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:25.245339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b692-6c12-4b09-b033-5e5f6f91e603 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:25.245765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b692-6c12-4b09-b033-5e5f6f91e603 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:25.246180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b692-6c12-4b09-b033-5e5f6f91e603 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:25.247320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b692-6c12-4b09-b033-5e5f6f91e603 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:25.247767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b692-6c12-4b09-b033-5e5f6f91e603 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:25.249250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b692-6c12-4b09-b033-5e5f6f91e603 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:25.259566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:25.265513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 344/698] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:25.267338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720316a-fdf8-4e29-9f12-2a50630c2e42 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:25.273252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720316a-fdf8-4e29-9f12-2a50630c2e42 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:25.273734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720316a-fdf8-4e29-9f12-2a50630c2e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:25.295311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b720316a-fdf8-4e29-9f12-2a50630c2e42 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:25.296532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b720316a-fdf8-4e29-9f12-2a50630c2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:25.315258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e2e11-dcb1-4913-9641-60105d5d5a5b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:25.352041 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeac6c-f931-49bf-9ceb-4fa1a945bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:25.353092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeac6c-f931-49bf-9ceb-4fa1a945bae7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:25.353717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeac6c-f931-49bf-9ceb-4fa1a945bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:25.354231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeac6c-f931-49bf-9ceb-4fa1a945bae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:25.373062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 345/699] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:25.373062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720316a-fdf8-4e29-9f12-2a50630c2e42 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:25.470656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeac6c-f931-49bf-9ceb-4fa1a945bae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:25.472190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeac6c-f931-49bf-9ceb-4fa1a945bae7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:25.506135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720316a-fdf8-4e29-9f12-2a50630c2e42 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:25.532356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:25.581781 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae402eb2-5bd7-4ec3-925d-fa12807625bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:25.582426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402eb2-5bd7-4ec3-925d-fa12807625bb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:25.582708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402eb2-5bd7-4ec3-925d-fa12807625bb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:25.583048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402eb2-5bd7-4ec3-925d-fa12807625bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:25.583797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae402eb2-5bd7-4ec3-925d-fa12807625bb None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=8834ef19c2604e8c828aa4dd32db61a7) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:25.584107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae402eb2-5bd7-4ec3-925d-fa12807625bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:25.587043 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae402eb2-5bd7-4ec3-925d-fa12807625bb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:25.593881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 346/700] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:25 2022] GET /identity/v3/role_assignments?user.id=8834ef19c2604e8c828aa4dd32db61a7&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:25.594369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:25.595128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b23b57-3c81-422a-95cf-f83bbe195527 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:25.595387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b23b57-3c81-422a-95cf-f83bbe195527 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:25.595659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b23b57-3c81-422a-95cf-f83bbe195527 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:25.601500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 347/701] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:25.603039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce621d1-a919-459a-b78d-7bf31feecd50 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:25.603270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce621d1-a919-459a-b78d-7bf31feecd50 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:25.603549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce621d1-a919-459a-b78d-7bf31feecd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:25.623550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9ce621d1-a919-459a-b78d-7bf31feecd50 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:25.624849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9ce621d1-a919-459a-b78d-7bf31feecd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:25.694785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 355/702] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:25.702558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeac6c-f931-49bf-9ceb-4fa1a945bae7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:25.739741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 348/703] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:25.741491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce621d1-a919-459a-b78d-7bf31feecd50 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:25.863640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeac6c-f931-49bf-9ceb-4fa1a945bae7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:25.922458 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce621d1-a919-459a-b78d-7bf31feecd50 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:25.926904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f1f6a-d7a9-4042-825e-a4716205b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:25.927816 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f1f6a-d7a9-4042-825e-a4716205b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:25.928317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f1f6a-d7a9-4042-825e-a4716205b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:25.928774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f1f6a-d7a9-4042-825e-a4716205b7c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:25.932053 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:25.944656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f1f6a-d7a9-4042-825e-a4716205b7c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:25.947048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f1f6a-d7a9-4042-825e-a4716205b7c4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:25.962896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d8cda-872a-4ae4-ba7f-0561b6b0ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:25.963538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d8cda-872a-4ae4-ba7f-0561b6b0ac91 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:25.963881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d8cda-872a-4ae4-ba7f-0561b6b0ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:25.964159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d8cda-872a-4ae4-ba7f-0561b6b0ac91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-390f1f6a-d7a9-4042-825e-a4716205b7c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:25.967859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:25.968753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:25.969660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:25.969660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:25.969660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:25.970539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 356/704] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:25.976517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f1f6a-d7a9-4042-825e-a4716205b7c4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:25.976812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d8cda-872a-4ae4-ba7f-0561b6b0ac91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:25.978298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d8cda-872a-4ae4-ba7f-0561b6b0ac91 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-bc9d8cda-872a-4ae4-ba7f-0561b6b0ac91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:25.994359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:25.995340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:25.996214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:25.996214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:25.996214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:25.996214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 349/705] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:26.003601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:26.005096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d8cda-872a-4ae4-ba7f-0561b6b0ac91 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:26.124139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f1f6a-d7a9-4042-825e-a4716205b7c4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:26.141013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d8cda-872a-4ae4-ba7f-0561b6b0ac91 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:26.174194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6fbf3-6389-44b9-b85b-de8fcd785a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:26.175255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6fbf3-6389-44b9-b85b-de8fcd785a8d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.175536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6fbf3-6389-44b9-b85b-de8fcd785a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.175808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6fbf3-6389-44b9-b85b-de8fcd785a8d None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.176466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6fbf3-6389-44b9-b85b-de8fcd785a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:26.176829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6fbf3-6389-44b9-b85b-de8fcd785a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:26.178578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6fbf3-6389-44b9-b85b-de8fcd785a8d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:26.192800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b997d-8844-49a2-b7c4-3e8b9d506f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:26.193751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b997d-8844-49a2-b7c4-3e8b9d506f05 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.194233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b997d-8844-49a2-b7c4-3e8b9d506f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.194730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b997d-8844-49a2-b7c4-3e8b9d506f05 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.195580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b997d-8844-49a2-b7c4-3e8b9d506f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:26.196083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b997d-8844-49a2-b7c4-3e8b9d506f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:26.197675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b997d-8844-49a2-b7c4-3e8b9d506f05 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:26.198579 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 357/706] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:26.199524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6fbf3-6389-44b9-b85b-de8fcd785a8d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:26.212695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 350/707] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:26.214184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b997d-8844-49a2-b7c4-3e8b9d506f05 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:26.236004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:26.275859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:26.323266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6fbf3-6389-44b9-b85b-de8fcd785a8d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:26.333787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b997d-8844-49a2-b7c4-3e8b9d506f05 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:26.357694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee039-f45f-49f2-b6ec-260cbae5016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:26.358334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee039-f45f-49f2-b6ec-260cbae5016a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.358611 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee039-f45f-49f2-b6ec-260cbae5016a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.358877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee039-f45f-49f2-b6ec-260cbae5016a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.359460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ee039-f45f-49f2-b6ec-260cbae5016a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:26.360840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ee039-f45f-49f2-b6ec-260cbae5016a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-294ee039-f45f-49f2-b6ec-260cbae5016a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:26.371646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:26.372885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:57:26.374006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:26.377255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 358/708] 10.222.0.76 () {56 vars in 1129 bytes} [Mon Sep 19 16:57:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:26.378205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee039-f45f-49f2-b6ec-260cbae5016a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:26.379153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70744f-e815-48a3-9baa-76e751d61fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:26.379865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70744f-e815-48a3-9baa-76e751d61fcc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.380149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70744f-e815-48a3-9baa-76e751d61fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.380426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70744f-e815-48a3-9baa-76e751d61fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.388272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70744f-e815-48a3-9baa-76e751d61fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:26.389780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70744f-e815-48a3-9baa-76e751d61fcc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-1b70744f-e815-48a3-9baa-76e751d61fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:26.401844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:26.402769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 351/709] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5c1b2-7f9f-46d5-8477-5a004fd583cf None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.408813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5c1b2-7f9f-46d5-8477-5a004fd583cf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.409668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5c1b2-7f9f-46d5-8477-5a004fd583cf None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.409668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 352/710] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:26.409668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5c1b2-7f9f-46d5-8477-5a004fd583cf None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:26.489712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:26.499806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee039-f45f-49f2-b6ec-260cbae5016a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:26.517642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5c1b2-7f9f-46d5-8477-5a004fd583cf None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:26.528224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:26.537546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b032f9-ba8e-4acf-9023-4e3744d8eadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:26.538164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b032f9-ba8e-4acf-9023-4e3744d8eadd None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.538439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b032f9-ba8e-4acf-9023-4e3744d8eadd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.538710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b032f9-ba8e-4acf-9023-4e3744d8eadd None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.539362 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b032f9-ba8e-4acf-9023-4e3744d8eadd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:26.540801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b032f9-ba8e-4acf-9023-4e3744d8eadd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:26.558937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3eb712-2566-4b12-b69f-c52893ffafbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:26.559538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb712-2566-4b12-b69f-c52893ffafbd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.559822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb712-2566-4b12-b69f-c52893ffafbd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.560165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3eb712-2566-4b12-b69f-c52893ffafbd None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.560774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eb712-2566-4b12-b69f-c52893ffafbd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:26.561107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eb712-2566-4b12-b69f-c52893ffafbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:26.562471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3eb712-2566-4b12-b69f-c52893ffafbd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:26.572284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 359/711] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:57:26 2022] POST /identity/v3/users => generated 254 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:26.572284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b032f9-ba8e-4acf-9023-4e3744d8eadd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:26.572664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 353/712] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Sep 19 16:57:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:26.572664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e45c03-fd0e-4f16-9c47-4ca52875ed95 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.572664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e45c03-fd0e-4f16-9c47-4ca52875ed95 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.572664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e45c03-fd0e-4f16-9c47-4ca52875ed95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.589683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-84e45c03-fd0e-4f16-9c47-4ca52875ed95 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:26.590986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-84e45c03-fd0e-4f16-9c47-4ca52875ed95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:26.677787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 354/713] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:26.678972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e45c03-fd0e-4f16-9c47-4ca52875ed95 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:26.705638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b032f9-ba8e-4acf-9023-4e3744d8eadd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:26.749945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7637ef-c8e1-4572-b573-83dfa1ae5c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:26.750871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7637ef-c8e1-4572-b573-83dfa1ae5c76 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.751161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7637ef-c8e1-4572-b573-83dfa1ae5c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.751440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7637ef-c8e1-4572-b573-83dfa1ae5c76 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.752302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7637ef-c8e1-4572-b573-83dfa1ae5c76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:26.752628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7637ef-c8e1-4572-b573-83dfa1ae5c76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:26.754959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7637ef-c8e1-4572-b573-83dfa1ae5c76 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:26.774718 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 360/714] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:26.781254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7637ef-c8e1-4572-b573-83dfa1ae5c76 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:26.783425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:26.825289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e45c03-fd0e-4f16-9c47-4ca52875ed95 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:26.845049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:26.869295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f8ace-91ef-42b5-864b-61d8ca8d93cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:26.870233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f8ace-91ef-42b5-864b-61d8ca8d93cb None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.870574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f8ace-91ef-42b5-864b-61d8ca8d93cb None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.870940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f8ace-91ef-42b5-864b-61d8ca8d93cb None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.872167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f8ace-91ef-42b5-864b-61d8ca8d93cb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:26.872671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f8ace-91ef-42b5-864b-61d8ca8d93cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:26.874182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f8ace-91ef-42b5-864b-61d8ca8d93cb None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:26.883183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 355/715] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Sep 19 16:57:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:26.915415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7637ef-c8e1-4572-b573-83dfa1ae5c76 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:26.958960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe925bb-afdf-4c14-b29f-8a4344fa6924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:26.959551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe925bb-afdf-4c14-b29f-8a4344fa6924 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:26.959835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe925bb-afdf-4c14-b29f-8a4344fa6924 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:26.960100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe925bb-afdf-4c14-b29f-8a4344fa6924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:26.960884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe925bb-afdf-4c14-b29f-8a4344fa6924 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=ea18c782ddf2469fa3d10a135fc34c37) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:26.961219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe925bb-afdf-4c14-b29f-8a4344fa6924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:26.962687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe925bb-afdf-4c14-b29f-8a4344fa6924 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:26.969628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 361/716] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:26 2022] GET /identity/v3/role_assignments?user.id=ea18c782ddf2469fa3d10a135fc34c37&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=77285ef607e34662b6234656fe8043d0 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:27.005326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f8ace-91ef-42b5-864b-61d8ca8d93cb None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:27.128868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f8ace-91ef-42b5-864b-61d8ca8d93cb None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:27.185417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe8997-e1e5-4229-997a-3615f0b24808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:27.186074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe8997-e1e5-4229-997a-3615f0b24808 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:27.186358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe8997-e1e5-4229-997a-3615f0b24808 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:27.186632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe8997-e1e5-4229-997a-3615f0b24808 None admin] PATH_INFO: `/v3/services/network` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:27.187232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe8997-e1e5-4229-997a-3615f0b24808 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:27.188698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe8997-e1e5-4229-997a-3615f0b24808 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:27.193368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-bbbe8997-e1e5-4229-997a-3615f0b24808 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:27.204270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:27.205817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:57:27.206679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:27.209459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 356/717] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:27 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:27.211969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe925bb-afdf-4c14-b29f-8a4344fa6924 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:27.320872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe925bb-afdf-4c14-b29f-8a4344fa6924 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:27.330498 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:27.356373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572a365-3703-4dd0-9167-779f00b49527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:27.356989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572a365-3703-4dd0-9167-779f00b49527 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:27.357300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572a365-3703-4dd0-9167-779f00b49527 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:27.357572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572a365-3703-4dd0-9167-779f00b49527 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:27.358298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572a365-3703-4dd0-9167-779f00b49527 None admin] RBAC: Adding query filter params (name=network) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:27.358598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572a365-3703-4dd0-9167-779f00b49527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:27.359993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572a365-3703-4dd0-9167-779f00b49527 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:27.372080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 362/718] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:57:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:27.381139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe8997-e1e5-4229-997a-3615f0b24808 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:27.490548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe8997-e1e5-4229-997a-3615f0b24808 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:27.524771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989aa51-27c0-42ef-809c-e7d9da60e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:27.525426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989aa51-27c0-42ef-809c-e7d9da60e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:27.525709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989aa51-27c0-42ef-809c-e7d9da60e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:27.525983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989aa51-27c0-42ef-809c-e7d9da60e1c3 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:27.526684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989aa51-27c0-42ef-809c-e7d9da60e1c3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:27.526980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989aa51-27c0-42ef-809c-e7d9da60e1c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:27.528359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989aa51-27c0-42ef-809c-e7d9da60e1c3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:27.536108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 357/719] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:57:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:28.412333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b80a7-4821-434f-84ed-52788ba3beac None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:28.412861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b80a7-4821-434f-84ed-52788ba3beac None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:28.412861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b80a7-4821-434f-84ed-52788ba3beac None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:28.414398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 363/720] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:28.419854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825755-09d4-4405-95e9-e972332898f3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:28.420427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825755-09d4-4405-95e9-e972332898f3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:28.420706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4825755-09d4-4405-95e9-e972332898f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:28.438977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f4825755-09d4-4405-95e9-e972332898f3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:28.440176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f4825755-09d4-4405-95e9-e972332898f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:28.514758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:28.528248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 358/721] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:28.957894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b80a7-4821-434f-84ed-52788ba3beac None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:29.097605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b80a7-4821-434f-84ed-52788ba3beac None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:29.147083 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df3970-9304-44fa-8610-3aefaf1aa6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:29.150409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df3970-9304-44fa-8610-3aefaf1aa6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:29.150409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df3970-9304-44fa-8610-3aefaf1aa6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:29.150409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df3970-9304-44fa-8610-3aefaf1aa6c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:29.161224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df3970-9304-44fa-8610-3aefaf1aa6c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-86df3970-9304-44fa-8610-3aefaf1aa6c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:29.166453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:29.167370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:29.168241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 364/722] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:29.173699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4825755-09d4-4405-95e9-e972332898f3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:29.292504 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4825755-09d4-4405-95e9-e972332898f3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:29.336090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46aa51-744f-4c18-af73-5a1de72aced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:29.337117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46aa51-744f-4c18-af73-5a1de72aced9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:29.337625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46aa51-744f-4c18-af73-5a1de72aced9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:29.338094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46aa51-744f-4c18-af73-5a1de72aced9 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:29.338958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46aa51-744f-4c18-af73-5a1de72aced9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:29.339460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46aa51-744f-4c18-af73-5a1de72aced9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:29.341054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46aa51-744f-4c18-af73-5a1de72aced9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:29.350150 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 359/723] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:29.358146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df3970-9304-44fa-8610-3aefaf1aa6c1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:29.407529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:29.507987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df3970-9304-44fa-8610-3aefaf1aa6c1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:29.552588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092d82d-975c-4f7d-9f8c-2ba98a1f1f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:29.553177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092d82d-975c-4f7d-9f8c-2ba98a1f1f59 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:29.553455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092d82d-975c-4f7d-9f8c-2ba98a1f1f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:29.553727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092d82d-975c-4f7d-9f8c-2ba98a1f1f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:29.566151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092d82d-975c-4f7d-9f8c-2ba98a1f1f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:29.567779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092d82d-975c-4f7d-9f8c-2ba98a1f1f59 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a092d82d-975c-4f7d-9f8c-2ba98a1f1f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:29.589619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:29.590749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:29.591654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:29.591654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:29.591654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:29.591654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 365/724] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:29.594021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fb1fe-8580-4d02-9d55-87591a8eac77 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:29.594870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fb1fe-8580-4d02-9d55-87591a8eac77 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:29.595388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fb1fe-8580-4d02-9d55-87591a8eac77 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:29.596958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 360/725] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:29.602159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092d82d-975c-4f7d-9f8c-2ba98a1f1f59 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:29.602536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96ff4c-9588-48f3-9e9a-352c2b9864a2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:29.602823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96ff4c-9588-48f3-9e9a-352c2b9864a2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:29.603100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96ff4c-9588-48f3-9e9a-352c2b9864a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:29.621542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cd96ff4c-9588-48f3-9e9a-352c2b9864a2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:29.622740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cd96ff4c-9588-48f3-9e9a-352c2b9864a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:29.681529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:29.700858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 361/726] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:57:29.702439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6e0a1-9ec6-4931-a83f-62593d9454d4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:29.702733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6e0a1-9ec6-4931-a83f-62593d9454d4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:29.702998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6e0a1-9ec6-4931-a83f-62593d9454d4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:29.704501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 362/727] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:29.710340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f2f11-6cc5-4a47-aea3-91099d33da5f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:29.710612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f2f11-6cc5-4a47-aea3-91099d33da5f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:29.710893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f2f11-6cc5-4a47-aea3-91099d33da5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:29.748512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0f3f2f11-6cc5-4a47-aea3-91099d33da5f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:29.749750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0f3f2f11-6cc5-4a47-aea3-91099d33da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:29.767373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:29.798529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092d82d-975c-4f7d-9f8c-2ba98a1f1f59 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:29.874840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 363/728] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 16:57:29.878768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8d2e6-db23-43ec-bcaa-6d691a4281fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:29.879394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8d2e6-db23-43ec-bcaa-6d691a4281fd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:29.879782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8d2e6-db23-43ec-bcaa-6d691a4281fd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:29.880055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8d2e6-db23-43ec-bcaa-6d691a4281fd None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:29.880717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8d2e6-db23-43ec-bcaa-6d691a4281fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:29.881019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8d2e6-db23-43ec-bcaa-6d691a4281fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:29.882496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8d2e6-db23-43ec-bcaa-6d691a4281fd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:29.902258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 366/729] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:29.907521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f2f11-6cc5-4a47-aea3-91099d33da5f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:29.955027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e20b8-0a7a-4b70-b663-6fee62552bd3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:29.955305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e20b8-0a7a-4b70-b663-6fee62552bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:29.955582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e20b8-0a7a-4b70-b663-6fee62552bd3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:29.956930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 367/730] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:29.962016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b02d3-1671-4d43-8eca-3ecea2ceb9b1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:29.962286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b02d3-1671-4d43-8eca-3ecea2ceb9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:29.962551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b02d3-1671-4d43-8eca-3ecea2ceb9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:29.990358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d25b02d3-1671-4d43-8eca-3ecea2ceb9b1 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:29.991557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d25b02d3-1671-4d43-8eca-3ecea2ceb9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:30.068299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f2f11-6cc5-4a47-aea3-91099d33da5f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:30.084169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 368/731] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:30.085069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b02d3-1671-4d43-8eca-3ecea2ceb9b1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:30.095001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:30.124541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa03e3-7917-4503-add9-db0515faf58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:30.125265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa03e3-7917-4503-add9-db0515faf58e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:30.125481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa03e3-7917-4503-add9-db0515faf58e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:30.125749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa03e3-7917-4503-add9-db0515faf58e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:30.137071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa03e3-7917-4503-add9-db0515faf58e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:30.138682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa03e3-7917-4503-add9-db0515faf58e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:30.169328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:30.198331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b02d3-1671-4d43-8eca-3ecea2ceb9b1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:30.236719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a58d4-3b58-4f2a-b926-43aeac0d5d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:30.237422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a58d4-3b58-4f2a-b926-43aeac0d5d1a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:30.237700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a58d4-3b58-4f2a-b926-43aeac0d5d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:30.238255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a58d4-3b58-4f2a-b926-43aeac0d5d1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:30.250465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a58d4-3b58-4f2a-b926-43aeac0d5d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-179a58d4-3b58-4f2a-b926-43aeac0d5d1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:30.255411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:30.256358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:30.257216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:30.261364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 369/732] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:30.262741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b0b64-eda7-4f0c-a68e-2b96658805c5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:30.263048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b0b64-eda7-4f0c-a68e-2b96658805c5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:30.263317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b0b64-eda7-4f0c-a68e-2b96658805c5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:30.264778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 370/733] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:30.265338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b0b64-eda7-4f0c-a68e-2b96658805c5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c3aa03e3-7917-4503-add9-db0515faf58e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:30.280538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:30.281599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:30.282566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:30.282566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:30.282566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:30.282566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:30.282566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:30.282566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:30.282566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:30.282566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:30.282566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:30.282566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:30.286462 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 364/734] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:30.287535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa03e3-7917-4503-add9-db0515faf58e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:30.371972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b0b64-eda7-4f0c-a68e-2b96658805c5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:30.394953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa03e3-7917-4503-add9-db0515faf58e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:30.406348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ebf7f-9996-4482-a5db-f1a95fe09aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:30.406959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ebf7f-9996-4482-a5db-f1a95fe09aae None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:30.407235 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ebf7f-9996-4482-a5db-f1a95fe09aae None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:30.407502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ebf7f-9996-4482-a5db-f1a95fe09aae None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:30.408151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ebf7f-9996-4482-a5db-f1a95fe09aae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:30.409565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ebf7f-9996-4482-a5db-f1a95fe09aae None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:30.412980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:30.426145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 371/735] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:57:30 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:30.427479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd0aad-c638-46ef-9e45-4867cb5e9fe1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:30.427761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd0aad-c638-46ef-9e45-4867cb5e9fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:30.428032 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd0aad-c638-46ef-9e45-4867cb5e9fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:30.447469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb63c10-e53f-42f8-a9dd-5d33027755bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:30.448108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63c10-e53f-42f8-a9dd-5d33027755bf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:30.448387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63c10-e53f-42f8-a9dd-5d33027755bf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:30.448675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb63c10-e53f-42f8-a9dd-5d33027755bf None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:30.448861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bbbd0aad-c638-46ef-9e45-4867cb5e9fe1 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:30.449385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb63c10-e53f-42f8-a9dd-5d33027755bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:30.449710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb63c10-e53f-42f8-a9dd-5d33027755bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:30.450171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bbbd0aad-c638-46ef-9e45-4867cb5e9fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:30.451122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb63c10-e53f-42f8-a9dd-5d33027755bf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:30.461962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 365/736] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:30.462846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb63c10-e53f-42f8-a9dd-5d33027755bf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:30.502545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:30.532353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 372/737] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 16:57:30.533262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd0aad-c638-46ef-9e45-4867cb5e9fe1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:30.595379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb63c10-e53f-42f8-a9dd-5d33027755bf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:30.642139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad416497-3522-4064-857a-43fe92e9196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:30.643203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad416497-3522-4064-857a-43fe92e9196f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:30.643637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad416497-3522-4064-857a-43fe92e9196f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:30.643916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad416497-3522-4064-857a-43fe92e9196f None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:30.645092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad416497-3522-4064-857a-43fe92e9196f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:30.645597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad416497-3522-4064-857a-43fe92e9196f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:30.647042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad416497-3522-4064-857a-43fe92e9196f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:30.664317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd0aad-c638-46ef-9e45-4867cb5e9fe1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:30.666842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 366/738] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Sep 19 16:57:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:30.667870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad416497-3522-4064-857a-43fe92e9196f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:30.704861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:30.720356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f73fac-8a6f-4e5a-866d-13cf1bab1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:30.720998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f73fac-8a6f-4e5a-866d-13cf1bab1131 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:30.721300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f73fac-8a6f-4e5a-866d-13cf1bab1131 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:30.721567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f73fac-8a6f-4e5a-866d-13cf1bab1131 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:30.735032 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f73fac-8a6f-4e5a-866d-13cf1bab1131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-84f73fac-8a6f-4e5a-866d-13cf1bab1131 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:30.741223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:30.742157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:30.743014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 373/739] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:30.743696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f73fac-8a6f-4e5a-866d-13cf1bab1131 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:30.794306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:30.804806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad416497-3522-4064-857a-43fe92e9196f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:30.842774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b835c7-8d4b-4f7b-bfd2-ac579061ca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:30.843399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b835c7-8d4b-4f7b-bfd2-ac579061ca13 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:30.843675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b835c7-8d4b-4f7b-bfd2-ac579061ca13 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:30.843948 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b835c7-8d4b-4f7b-bfd2-ac579061ca13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:30.850679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f73fac-8a6f-4e5a-866d-13cf1bab1131 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:30.855138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b835c7-8d4b-4f7b-bfd2-ac579061ca13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:30.856642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b835c7-8d4b-4f7b-bfd2-ac579061ca13 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-16b835c7-8d4b-4f7b-bfd2-ac579061ca13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:30.873071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:30.874140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:30.875002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:30.875002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:30.875002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:30.876483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 367/740] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:30.877422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b835c7-8d4b-4f7b-bfd2-ac579061ca13 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:30.891080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e23b4-ba0d-497c-a0c8-3f7ff4477e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:30.891687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e23b4-ba0d-497c-a0c8-3f7ff4477e88 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:30.892009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e23b4-ba0d-497c-a0c8-3f7ff4477e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:30.892271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e23b4-ba0d-497c-a0c8-3f7ff4477e88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:30.945868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:30.962737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e23b4-ba0d-497c-a0c8-3f7ff4477e88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:30.964510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e23b4-ba0d-497c-a0c8-3f7ff4477e88 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:30.986512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b835c7-8d4b-4f7b-bfd2-ac579061ca13 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:31.021647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0a7c-c33e-44d7-ac25-36579e564c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:31.022267 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0a7c-c33e-44d7-ac25-36579e564c07 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:31.022553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0a7c-c33e-44d7-ac25-36579e564c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:31.022828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0a7c-c33e-44d7-ac25-36579e564c07 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:31.023530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec0a7c-c33e-44d7-ac25-36579e564c07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:31.023833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec0a7c-c33e-44d7-ac25-36579e564c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:31.025229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec0a7c-c33e-44d7-ac25-36579e564c07 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:31.033857 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 368/741] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:31.034408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0a7c-c33e-44d7-ac25-36579e564c07 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.045712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:31.086766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 374/742] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:30 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 16:57:31.086766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e23b4-ba0d-497c-a0c8-3f7ff4477e88 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.143076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0a7c-c33e-44d7-ac25-36579e564c07 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:31.181310 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8ed7-504e-4ee2-a7b7-31e031e684dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:31.182403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8ed7-504e-4ee2-a7b7-31e031e684dd None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:31.183042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8ed7-504e-4ee2-a7b7-31e031e684dd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:31.183379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a8ed7-504e-4ee2-a7b7-31e031e684dd None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:31.184039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a8ed7-504e-4ee2-a7b7-31e031e684dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:31.185607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:31.186467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a8ed7-504e-4ee2-a7b7-31e031e684dd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:31.202088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e23b4-ba0d-497c-a0c8-3f7ff4477e88 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:31.204359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 369/743] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:57:31 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:31.205222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8ed7-504e-4ee2-a7b7-31e031e684dd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.268613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfda4b-c98a-4ebd-8214-bdf5b0eb48f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:31.270080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfda4b-c98a-4ebd-8214-bdf5b0eb48f7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:31.270627 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfda4b-c98a-4ebd-8214-bdf5b0eb48f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:31.271873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfda4b-c98a-4ebd-8214-bdf5b0eb48f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:31.273301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfda4b-c98a-4ebd-8214-bdf5b0eb48f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:31.273860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfda4b-c98a-4ebd-8214-bdf5b0eb48f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:31.275695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfda4b-c98a-4ebd-8214-bdf5b0eb48f7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:31.290795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:31.301772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 375/744] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:31.303004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfda4b-c98a-4ebd-8214-bdf5b0eb48f7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.336749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a8ed7-504e-4ee2-a7b7-31e031e684dd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:31.384072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a846f-e638-4b70-9a10-66baac58b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:31.385074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a846f-e638-4b70-9a10-66baac58b864 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:31.385074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a846f-e638-4b70-9a10-66baac58b864 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:31.385318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a846f-e638-4b70-9a10-66baac58b864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:31.399249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a846f-e638-4b70-9a10-66baac58b864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:31.400751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a846f-e638-4b70-9a10-66baac58b864 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8a7a846f-e638-4b70-9a10-66baac58b864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:31.418841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:31.419832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:31.421243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:31.421243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:31.421243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:31.421243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 370/745] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:31.421243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a846f-e638-4b70-9a10-66baac58b864 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.441891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfda4b-c98a-4ebd-8214-bdf5b0eb48f7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:31.480159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8be005-de90-4338-8be8-292585a6ca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:31.480544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8be005-de90-4338-8be8-292585a6ca85 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:31.480821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8be005-de90-4338-8be8-292585a6ca85 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:31.481135 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8be005-de90-4338-8be8-292585a6ca85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:31.490636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:31.493425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8be005-de90-4338-8be8-292585a6ca85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:31.494681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8be005-de90-4338-8be8-292585a6ca85 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8d8be005-de90-4338-8be8-292585a6ca85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:31.510055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:31.511020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:31.511878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:31.511878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:31.511878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:31.511878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 376/746] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:31.511878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8be005-de90-4338-8be8-292585a6ca85 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.550206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a846f-e638-4b70-9a10-66baac58b864 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:31.573419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:31.592514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f83159-99f8-44af-b87f-967f575e6ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:31.593057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f83159-99f8-44af-b87f-967f575e6ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:31.593342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f83159-99f8-44af-b87f-967f575e6ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:31.593614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f83159-99f8-44af-b87f-967f575e6ff5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:31.601800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f83159-99f8-44af-b87f-967f575e6ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:31.602979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f83159-99f8-44af-b87f-967f575e6ff5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-44f83159-99f8-44af-b87f-967f575e6ff5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:31.614582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:31.615626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:31.616548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 371/747] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Sep 19 16:57:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:31.617153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f83159-99f8-44af-b87f-967f575e6ff5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.634173 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8be005-de90-4338-8be8-292585a6ca85 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:31.680736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e767113-41d4-4764-a233-4c33d82644bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:31.681892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e767113-41d4-4764-a233-4c33d82644bc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:31.682313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e767113-41d4-4764-a233-4c33d82644bc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:31.683114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e767113-41d4-4764-a233-4c33d82644bc None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:31.684163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e767113-41d4-4764-a233-4c33d82644bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:31.684624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e767113-41d4-4764-a233-4c33d82644bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:31.686927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e767113-41d4-4764-a233-4c33d82644bc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:31.707674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 377/748] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:31.707674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e767113-41d4-4764-a233-4c33d82644bc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.732584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f83159-99f8-44af-b87f-967f575e6ff5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:31.770646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f9a3e-0322-416a-b6af-55618a7b8554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:31.771271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f9a3e-0322-416a-b6af-55618a7b8554 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:31.771555 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f9a3e-0322-416a-b6af-55618a7b8554 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:31.771825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f9a3e-0322-416a-b6af-55618a7b8554 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:31.772480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f9a3e-0322-416a-b6af-55618a7b8554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:31.772781 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f9a3e-0322-416a-b6af-55618a7b8554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:31.774190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f9a3e-0322-416a-b6af-55618a7b8554 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:31.781118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:31.792533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 372/749] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:31.793508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f9a3e-0322-416a-b6af-55618a7b8554 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.831710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e767113-41d4-4764-a233-4c33d82644bc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:31.836651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:31.867716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc25e46-0472-46e1-9cdf-fcde70c46c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:31.868678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc25e46-0472-46e1-9cdf-fcde70c46c7c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:31.869197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc25e46-0472-46e1-9cdf-fcde70c46c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:31.869619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc25e46-0472-46e1-9cdf-fcde70c46c7c None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:31.870355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc25e46-0472-46e1-9cdf-fcde70c46c7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:31.870652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc25e46-0472-46e1-9cdf-fcde70c46c7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:31.872075 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc25e46-0472-46e1-9cdf-fcde70c46c7c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:31.894107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 378/750] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Sep 19 16:57:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:31.894107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc25e46-0472-46e1-9cdf-fcde70c46c7c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.907771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f9a3e-0322-416a-b6af-55618a7b8554 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:31.941806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615e711-7f25-41db-ad77-6ba56861c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:31.942891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615e711-7f25-41db-ad77-6ba56861c232 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:31.943373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615e711-7f25-41db-ad77-6ba56861c232 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:31.943871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615e711-7f25-41db-ad77-6ba56861c232 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:31.951397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615e711-7f25-41db-ad77-6ba56861c232 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:31.953114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615e711-7f25-41db-ad77-6ba56861c232 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3615e711-7f25-41db-ad77-6ba56861c232 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:31.964995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:31.965983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:31.966907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:31.966907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:31.966907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:31.966907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:31.966907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:31.966907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:31.966907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:31.966907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:31.966907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:31.966907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:31.969440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 373/751] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Sep 19 16:57:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:31.970438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615e711-7f25-41db-ad77-6ba56861c232 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:31.999321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc25e46-0472-46e1-9cdf-fcde70c46c7c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:32.014289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:32.046153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c32826-c531-4733-a15e-b9e6bfe6fbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:32.046889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c32826-c531-4733-a15e-b9e6bfe6fbcb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.047236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c32826-c531-4733-a15e-b9e6bfe6fbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.047506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c32826-c531-4733-a15e-b9e6bfe6fbcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.054967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c32826-c531-4733-a15e-b9e6bfe6fbcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:32.056496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c32826-c531-4733-a15e-b9e6bfe6fbcb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-51c32826-c531-4733-a15e-b9e6bfe6fbcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:32.068450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:32.069623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:32.070636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:32.070636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:32.070636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:32.070636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:32.070636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:32.070636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:32.070636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:32.070636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:32.070636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 379/752] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:32.071356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c32826-c531-4733-a15e-b9e6bfe6fbcb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:32.092799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:32.097357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615e711-7f25-41db-ad77-6ba56861c232 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:32.132821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0519d8-f841-4e0c-bbb6-7f6de20f5dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:32.133905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0519d8-f841-4e0c-bbb6-7f6de20f5dcd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.134369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0519d8-f841-4e0c-bbb6-7f6de20f5dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.134852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0519d8-f841-4e0c-bbb6-7f6de20f5dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.183204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c32826-c531-4733-a15e-b9e6bfe6fbcb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:32.208518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0519d8-f841-4e0c-bbb6-7f6de20f5dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:32.210338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0519d8-f841-4e0c-bbb6-7f6de20f5dcd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:32.222141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8734b-707a-4c46-a6d1-a8de652434f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:32.222847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8734b-707a-4c46-a6d1-a8de652434f9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.223279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8734b-707a-4c46-a6d1-a8de652434f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.223540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8734b-707a-4c46-a6d1-a8de652434f9 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.224360 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8734b-707a-4c46-a6d1-a8de652434f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:32.224724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8734b-707a-4c46-a6d1-a8de652434f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:32.226358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8734b-707a-4c46-a6d1-a8de652434f9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:32.249447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 380/753] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Sep 19 16:57:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:32.250341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8734b-707a-4c46-a6d1-a8de652434f9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:32.280206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:32.309285 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:32.319040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 374/754] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:57:32.320191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0519d8-f841-4e0c-bbb6-7f6de20f5dcd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:32.358768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8734b-707a-4c46-a6d1-a8de652434f9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:32.395124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e8db2-25b9-4ec9-b6db-11fdc5201345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:32.395967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8db2-25b9-4ec9-b6db-11fdc5201345 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.396118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8db2-25b9-4ec9-b6db-11fdc5201345 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.396372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8db2-25b9-4ec9-b6db-11fdc5201345 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.397080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e8db2-25b9-4ec9-b6db-11fdc5201345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:32.397384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e8db2-25b9-4ec9-b6db-11fdc5201345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:32.398924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e8db2-25b9-4ec9-b6db-11fdc5201345 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:32.411948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 381/755] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:32.412964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e8db2-25b9-4ec9-b6db-11fdc5201345 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:32.422905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0519d8-f841-4e0c-bbb6-7f6de20f5dcd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:32.462495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29974243-b14a-4d75-9653-de4a171380a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:32.463511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974243-b14a-4d75-9653-de4a171380a2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.464022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974243-b14a-4d75-9653-de4a171380a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.464506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974243-b14a-4d75-9653-de4a171380a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.475617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29974243-b14a-4d75-9653-de4a171380a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:32.477432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29974243-b14a-4d75-9653-de4a171380a2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-29974243-b14a-4d75-9653-de4a171380a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:32.492689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:32.493801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:32.494695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:32.494695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:32.494695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:32.496814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 375/756] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:32.497912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29974243-b14a-4d75-9653-de4a171380a2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:32.513774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:32.528353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e8db2-25b9-4ec9-b6db-11fdc5201345 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:32.554439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:32.570313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f411-426d-47db-bbf7-31ce27b82534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:32.571231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f411-426d-47db-bbf7-31ce27b82534 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.571670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f411-426d-47db-bbf7-31ce27b82534 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.572079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043f411-426d-47db-bbf7-31ce27b82534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.585775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043f411-426d-47db-bbf7-31ce27b82534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:32.587659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043f411-426d-47db-bbf7-31ce27b82534 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9043f411-426d-47db-bbf7-31ce27b82534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:32.603346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:32.604325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:32.605430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:32.605430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:32.605430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:32.607222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 382/757] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:32.608153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f411-426d-47db-bbf7-31ce27b82534 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:32.615101 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29974243-b14a-4d75-9653-de4a171380a2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:32.650268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a7033-8f91-4a37-8210-7e8bd7e735a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:32.651039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a7033-8f91-4a37-8210-7e8bd7e735a1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.651428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a7033-8f91-4a37-8210-7e8bd7e735a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.651857 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a7033-8f91-4a37-8210-7e8bd7e735a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.652688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a7033-8f91-4a37-8210-7e8bd7e735a1 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=8834ef19c2604e8c828aa4dd32db61a7) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:32.653128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a7033-8f91-4a37-8210-7e8bd7e735a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:32.654908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a7033-8f91-4a37-8210-7e8bd7e735a1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:32.660905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 376/758] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:32 2022] GET /identity/v3/role_assignments?user.id=8834ef19c2604e8c828aa4dd32db61a7&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=77285ef607e34662b6234656fe8043d0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:32.661977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a7033-8f91-4a37-8210-7e8bd7e735a1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:32.720931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043f411-426d-47db-bbf7-31ce27b82534 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:32.760214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a335b5c-5b77-420d-9209-9e2fab550d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:32.761263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a335b5c-5b77-420d-9209-9e2fab550d2d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.761714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a335b5c-5b77-420d-9209-9e2fab550d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.762175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a335b5c-5b77-420d-9209-9e2fab550d2d None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.763257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a335b5c-5b77-420d-9209-9e2fab550d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:32.763751 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a335b5c-5b77-420d-9209-9e2fab550d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:32.765424 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a335b5c-5b77-420d-9209-9e2fab550d2d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:32.774052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a7033-8f91-4a37-8210-7e8bd7e735a1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:32.777626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:32.785337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 383/759] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:32.787365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ef92e-6d90-4c6b-a0f7-0c09a4f16375 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.787875 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ef92e-6d90-4c6b-a0f7-0c09a4f16375 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.788360 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ef92e-6d90-4c6b-a0f7-0c09a4f16375 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.791732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 384/760] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:32.792903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ef92e-6d90-4c6b-a0f7-0c09a4f16375 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:32.794690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:32.819230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668f1d0-8d9f-47ef-9e05-55b34e8744bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:32.819896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668f1d0-8d9f-47ef-9e05-55b34e8744bd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.820178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668f1d0-8d9f-47ef-9e05-55b34e8744bd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.820454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668f1d0-8d9f-47ef-9e05-55b34e8744bd None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.821159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668f1d0-8d9f-47ef-9e05-55b34e8744bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:32.821546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668f1d0-8d9f-47ef-9e05-55b34e8744bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:32.823233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668f1d0-8d9f-47ef-9e05-55b34e8744bd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:32.842600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 377/761] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:32.844105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3add263-f052-4924-929a-b7a7bc4cc8e7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.844413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3add263-f052-4924-929a-b7a7bc4cc8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.844681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3add263-f052-4924-929a-b7a7bc4cc8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.864131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a3add263-f052-4924-929a-b7a7bc4cc8e7 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:32.865390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a3add263-f052-4924-929a-b7a7bc4cc8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:32.910831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ef92e-6d90-4c6b-a0f7-0c09a4f16375 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:32.936025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 378/762] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:32.937121 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3add263-f052-4924-929a-b7a7bc4cc8e7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:32.947821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e347a5-0106-4cf8-a93d-6b627fdbbe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:32.948867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e347a5-0106-4cf8-a93d-6b627fdbbe97 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:32.949361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e347a5-0106-4cf8-a93d-6b627fdbbe97 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:32.949874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e347a5-0106-4cf8-a93d-6b627fdbbe97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:32.958876 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e347a5-0106-4cf8-a93d-6b627fdbbe97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:32.960571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e347a5-0106-4cf8-a93d-6b627fdbbe97 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-86e347a5-0106-4cf8-a93d-6b627fdbbe97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:32.976593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:32.977535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:32.978425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:32.978425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:32.978425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:32.978425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:32.978425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:32.978425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:32.978425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:32.978425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:32.980834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 385/763] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:32.986512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e347a5-0106-4cf8-a93d-6b627fdbbe97 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:33.082366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:33.116142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3add263-f052-4924-929a-b7a7bc4cc8e7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:33.118839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:33.155178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e347a5-0106-4cf8-a93d-6b627fdbbe97 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:33.184601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32ed23-c91d-4be5-a8fa-888718d2075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:33.185278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ed23-c91d-4be5-a8fa-888718d2075a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:33.185554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ed23-c91d-4be5-a8fa-888718d2075a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:33.185820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32ed23-c91d-4be5-a8fa-888718d2075a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:33.199947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32ed23-c91d-4be5-a8fa-888718d2075a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:33.201513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32ed23-c91d-4be5-a8fa-888718d2075a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5c32ed23-c91d-4be5-a8fa-888718d2075a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:33.218468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:33.219411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:33.220701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:33.220701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:33.220701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:33.220701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:33.220701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:33.220701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:33.220701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:33.220701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:33.220701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 379/764] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:33.227325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32ed23-c91d-4be5-a8fa-888718d2075a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:33.231724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77b4f9-d604-498a-9006-1ea8f761e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:33.232356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77b4f9-d604-498a-9006-1ea8f761e92c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:33.232629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77b4f9-d604-498a-9006-1ea8f761e92c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:33.232892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77b4f9-d604-498a-9006-1ea8f761e92c None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:33.233623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77b4f9-d604-498a-9006-1ea8f761e92c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:33.233921 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77b4f9-d604-498a-9006-1ea8f761e92c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:33.235359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77b4f9-d604-498a-9006-1ea8f761e92c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:33.262768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 386/765] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:33.267438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77b4f9-d604-498a-9006-1ea8f761e92c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:33.353384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32ed23-c91d-4be5-a8fa-888718d2075a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:33.391173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeceb37-b817-4281-a16f-6c4d36466ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:33.391797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeceb37-b817-4281-a16f-6c4d36466ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:33.392076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeceb37-b817-4281-a16f-6c4d36466ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:33.392345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeceb37-b817-4281-a16f-6c4d36466ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:33.393493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeceb37-b817-4281-a16f-6c4d36466ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:33.393806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeceb37-b817-4281-a16f-6c4d36466ba6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:33.395874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeceb37-b817-4281-a16f-6c4d36466ba6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:33.404313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77b4f9-d604-498a-9006-1ea8f761e92c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:33.413120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 380/766] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:33.414047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeceb37-b817-4281-a16f-6c4d36466ba6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:33.435055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:33.453443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:33.458622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972f6ab-3f3e-4240-850f-a77646dcac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:33.459957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972f6ab-3f3e-4240-850f-a77646dcac39 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:33.460438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972f6ab-3f3e-4240-850f-a77646dcac39 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:33.461410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972f6ab-3f3e-4240-850f-a77646dcac39 None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/ea18c782ddf2469fa3d10a135fc34c37/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:33.464007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972f6ab-3f3e-4240-850f-a77646dcac39 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=ea18c782ddf2469fa3d10a135fc34c37, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:33.465516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972f6ab-3f3e-4240-850f-a77646dcac39 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:33.484358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 387/767] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:57:33 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/ea18c782ddf2469fa3d10a135fc34c37/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:57:33.484358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972f6ab-3f3e-4240-850f-a77646dcac39 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:33.579053 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeceb37-b817-4281-a16f-6c4d36466ba6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:33.621992 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e230d-f475-479a-8fe3-3e39e495c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:33.622656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e230d-f475-479a-8fe3-3e39e495c02a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:33.622910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e230d-f475-479a-8fe3-3e39e495c02a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:33.629067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e230d-f475-479a-8fe3-3e39e495c02a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:33.629067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e230d-f475-479a-8fe3-3e39e495c02a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:33.629067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e230d-f475-479a-8fe3-3e39e495c02a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f50e230d-f475-479a-8fe3-3e39e495c02a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:33.635261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:33.636301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:33.637190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 381/768] 10.222.0.76 () {56 vars in 1129 bytes} [Mon Sep 19 16:57:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:33.638510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f17d0-7ab4-44a9-a358-d78ff7ebd0ac None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:33.638510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f17d0-7ab4-44a9-a358-d78ff7ebd0ac None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:33.638784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f17d0-7ab4-44a9-a358-d78ff7ebd0ac None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:33.640288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 382/769] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:33.645836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972f6ab-3f3e-4240-850f-a77646dcac39 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:33.651758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f17d0-7ab4-44a9-a358-d78ff7ebd0ac None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:33.684126 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca212837-af73-4949-a376-a27307e0a4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:33.684750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca212837-af73-4949-a376-a27307e0a4ab None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:33.685026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca212837-af73-4949-a376-a27307e0a4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:33.685317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca212837-af73-4949-a376-a27307e0a4ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:33.686067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca212837-af73-4949-a376-a27307e0a4ab None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=ee58334347c34e329ac250ae9e73aa93) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:33.686373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca212837-af73-4949-a376-a27307e0a4ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:33.687841 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca212837-af73-4949-a376-a27307e0a4ab None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:33.695539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 388/770] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:33 2022] GET /identity/v3/role_assignments?user.id=ee58334347c34e329ac250ae9e73aa93&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:33.697259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2227-3e66-44d7-bcf1-f4d847e28cda None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:33.697259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2227-3e66-44d7-bcf1-f4d847e28cda None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:33.697458 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2227-3e66-44d7-bcf1-f4d847e28cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:33.717775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-230b2227-3e66-44d7-bcf1-f4d847e28cda None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:33.719058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-230b2227-3e66-44d7-bcf1-f4d847e28cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:33.758516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:33.763536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:33.776582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f17d0-7ab4-44a9-a358-d78ff7ebd0ac None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:33.795818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 389/771] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:33.822510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b907cf-af20-4144-ad65-b2592979b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:33.823195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b907cf-af20-4144-ad65-b2592979b9cd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:33.823467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b907cf-af20-4144-ad65-b2592979b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:33.823765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b907cf-af20-4144-ad65-b2592979b9cd None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:33.824487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b907cf-af20-4144-ad65-b2592979b9cd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:33.824816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b907cf-af20-4144-ad65-b2592979b9cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:33.826422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b907cf-af20-4144-ad65-b2592979b9cd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:33.838070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 383/772] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Sep 19 16:57:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:33.843952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b2227-3e66-44d7-bcf1-f4d847e28cda None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:33.980302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b2227-3e66-44d7-bcf1-f4d847e28cda None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:34.015467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c264c11-277e-451d-a9dc-d61621ac38c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:34.016081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c264c11-277e-451d-a9dc-d61621ac38c8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:34.016356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c264c11-277e-451d-a9dc-d61621ac38c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:34.016624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c264c11-277e-451d-a9dc-d61621ac38c8 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:34.017293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c264c11-277e-451d-a9dc-d61621ac38c8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:34.017585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c264c11-277e-451d-a9dc-d61621ac38c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:34.018966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c264c11-277e-451d-a9dc-d61621ac38c8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:34.025900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 390/773] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Sep 19 16:57:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:34.034056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b907cf-af20-4144-ad65-b2592979b9cd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:34.172701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b907cf-af20-4144-ad65-b2592979b9cd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:34.207252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fae290-96b0-42bb-936c-e4d10a166914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:34.207907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fae290-96b0-42bb-936c-e4d10a166914 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:34.208192 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fae290-96b0-42bb-936c-e4d10a166914 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:34.208467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fae290-96b0-42bb-936c-e4d10a166914 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:34.209206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fae290-96b0-42bb-936c-e4d10a166914 None admin] RBAC: Adding query filter params (interface=public, service_id=87c1a3a863264be8bf533ca22f243ae2, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:34.209519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fae290-96b0-42bb-936c-e4d10a166914 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:34.211013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fae290-96b0-42bb-936c-e4d10a166914 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:34.218868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 384/774] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Sep 19 16:57:34 2022] GET /identity/v3/endpoints?service_id=87c1a3a863264be8bf533ca22f243ae2&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:34.219801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c264c11-277e-451d-a9dc-d61621ac38c8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:34.224711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fae290-96b0-42bb-936c-e4d10a166914 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:34.243460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:34.269194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:34.325721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fae290-96b0-42bb-936c-e4d10a166914 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:34.357074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c264c11-277e-451d-a9dc-d61621ac38c8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:34.362486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa80ce7-51c1-4888-86c2-a993f188c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:34.363304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa80ce7-51c1-4888-86c2-a993f188c3fe None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:34.368221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa80ce7-51c1-4888-86c2-a993f188c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:34.368721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa80ce7-51c1-4888-86c2-a993f188c3fe None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:34.369536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa80ce7-51c1-4888-86c2-a993f188c3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:34.371083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa80ce7-51c1-4888-86c2-a993f188c3fe None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:34.378574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 385/775] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Sep 19 16:57:34 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:34.404219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5257630-d93a-4540-a2ae-a1063027058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:34.405279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5257630-d93a-4540-a2ae-a1063027058e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:34.405733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5257630-d93a-4540-a2ae-a1063027058e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:34.406177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5257630-d93a-4540-a2ae-a1063027058e None admin] PATH_INFO: `/v3/services/network` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:34.406960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5257630-d93a-4540-a2ae-a1063027058e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:34.408560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5257630-d93a-4540-a2ae-a1063027058e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f5257630-d93a-4540-a2ae-a1063027058e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:34.418249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:34.419305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:57:34.420123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:34.423109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 391/776] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:34 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:34.429277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa80ce7-51c1-4888-86c2-a993f188c3fe None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:34.515681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:34.535112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa80ce7-51c1-4888-86c2-a993f188c3fe None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:34.571362 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652f5bd-f55b-4bfb-9a4e-fe3ba4e9e0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:34.571984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652f5bd-f55b-4bfb-9a4e-fe3ba4e9e0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:34.572260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652f5bd-f55b-4bfb-9a4e-fe3ba4e9e0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:34.572529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652f5bd-f55b-4bfb-9a4e-fe3ba4e9e0d6 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:34.573186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652f5bd-f55b-4bfb-9a4e-fe3ba4e9e0d6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:34.573483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652f5bd-f55b-4bfb-9a4e-fe3ba4e9e0d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:34.574854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652f5bd-f55b-4bfb-9a4e-fe3ba4e9e0d6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:34.579923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 386/777] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:57:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:34.585699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5257630-d93a-4540-a2ae-a1063027058e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:34.716495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5257630-d93a-4540-a2ae-a1063027058e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:34.718253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:34.752576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d16751-9986-4981-bad8-adeaf58dc8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:34.753447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d16751-9986-4981-bad8-adeaf58dc8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:34.753556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d16751-9986-4981-bad8-adeaf58dc8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:34.753745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d16751-9986-4981-bad8-adeaf58dc8d8 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:34.754379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d16751-9986-4981-bad8-adeaf58dc8d8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:34.754779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d16751-9986-4981-bad8-adeaf58dc8d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:34.756167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d16751-9986-4981-bad8-adeaf58dc8d8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:34.761432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 392/778] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:57:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:34.767167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652f5bd-f55b-4bfb-9a4e-fe3ba4e9e0d6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:34.880462 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652f5bd-f55b-4bfb-9a4e-fe3ba4e9e0d6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:34.919332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c7ca3-13c7-4606-aede-8647b51d062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:34.919945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c7ca3-13c7-4606-aede-8647b51d062d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:34.920222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c7ca3-13c7-4606-aede-8647b51d062d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:34.920492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c7ca3-13c7-4606-aede-8647b51d062d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:34.921216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c7ca3-13c7-4606-aede-8647b51d062d None admin] RBAC: Adding query filter params (interface=public, service_id=41bec24bd5834919a0188007597bec01, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:34.921523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c7ca3-13c7-4606-aede-8647b51d062d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:34.922880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c7ca3-13c7-4606-aede-8647b51d062d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:34.928439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 387/779] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Sep 19 16:57:34 2022] GET /identity/v3/endpoints?service_id=41bec24bd5834919a0188007597bec01&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:34.934135 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d16751-9986-4981-bad8-adeaf58dc8d8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:35.038696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d16751-9986-4981-bad8-adeaf58dc8d8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:35.073819 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab556139-43ba-4da4-b074-16cf663e48b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:35.074448 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556139-43ba-4da4-b074-16cf663e48b3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:35.074726 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556139-43ba-4da4-b074-16cf663e48b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:35.075031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab556139-43ba-4da4-b074-16cf663e48b3 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:35.075791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab556139-43ba-4da4-b074-16cf663e48b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:35.077268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab556139-43ba-4da4-b074-16cf663e48b3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:35.083111 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 393/780] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Sep 19 16:57:34 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:35.362378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96e748-3060-4030-9064-631ac5331409 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:35.362728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96e748-3060-4030-9064-631ac5331409 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:35.362900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96e748-3060-4030-9064-631ac5331409 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:35.364616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 388/781] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:35.371064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059892e-ed65-4a71-bf24-9bad3bf5ecce None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:35.371356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059892e-ed65-4a71-bf24-9bad3bf5ecce None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:35.371631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059892e-ed65-4a71-bf24-9bad3bf5ecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:35.390751 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4059892e-ed65-4a71-bf24-9bad3bf5ecce None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:35.391952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4059892e-ed65-4a71-bf24-9bad3bf5ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:35.416231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:35.465389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 394/782] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:35.797589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96e748-3060-4030-9064-631ac5331409 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:35.809374 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:35.938701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96e748-3060-4030-9064-631ac5331409 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:35.975304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12cf00-36cf-4bb9-8123-a20e78110d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:35.976026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12cf00-36cf-4bb9-8123-a20e78110d14 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:35.976299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12cf00-36cf-4bb9-8123-a20e78110d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:35.976570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12cf00-36cf-4bb9-8123-a20e78110d14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:35.986621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12cf00-36cf-4bb9-8123-a20e78110d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-2e12cf00-36cf-4bb9-8123-a20e78110d14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:35.991631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:35.992548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:35.993397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 389/783] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:35.999019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059892e-ed65-4a71-bf24-9bad3bf5ecce None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:36.130839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059892e-ed65-4a71-bf24-9bad3bf5ecce None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:36.170267 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466a397-41ec-4bf5-a312-7e71e70224c8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:36.170917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466a397-41ec-4bf5-a312-7e71e70224c8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:36.171379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466a397-41ec-4bf5-a312-7e71e70224c8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:36.173207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 390/784] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:36.178712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538d80f-114b-4c16-b225-9511bc2d50e8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:36.179259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538d80f-114b-4c16-b225-9511bc2d50e8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:36.179725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538d80f-114b-4c16-b225-9511bc2d50e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:36.200021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3538d80f-114b-4c16-b225-9511bc2d50e8 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:36.201608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3538d80f-114b-4c16-b225-9511bc2d50e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:36.206681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c60aee-6b1c-4257-b897-f455431ce8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:36.207374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60aee-6b1c-4257-b897-f455431ce8af None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:36.207744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60aee-6b1c-4257-b897-f455431ce8af None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:36.208020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60aee-6b1c-4257-b897-f455431ce8af None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:36.208701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c60aee-6b1c-4257-b897-f455431ce8af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:36.209003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c60aee-6b1c-4257-b897-f455431ce8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:36.210414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c60aee-6b1c-4257-b897-f455431ce8af None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:36.231612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 395/785] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:36.238562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c60aee-6b1c-4257-b897-f455431ce8af None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:36.290209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:36.339684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:36.349537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 391/786] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:57:36.368544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4112d1-6e7e-481e-ad05-0022506d38ad None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:36.368885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4112d1-6e7e-481e-ad05-0022506d38ad None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:36.369130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4112d1-6e7e-481e-ad05-0022506d38ad None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:36.370626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 392/787] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:36.375908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e9560-9e9b-4cf1-90ba-fb07a725c39d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:36.376185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e9560-9e9b-4cf1-90ba-fb07a725c39d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:36.376451 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e9560-9e9b-4cf1-90ba-fb07a725c39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:36.390103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c60aee-6b1c-4257-b897-f455431ce8af None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:36.398334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2c7e9560-9e9b-4cf1-90ba-fb07a725c39d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:36.399664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2c7e9560-9e9b-4cf1-90ba-fb07a725c39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:36.461314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b60be-201b-4ef7-97e8-cbe63dc5fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:36.462002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b60be-201b-4ef7-97e8-cbe63dc5fe47 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:36.462340 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b60be-201b-4ef7-97e8-cbe63dc5fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:36.462659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b60be-201b-4ef7-97e8-cbe63dc5fe47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:36.482105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b60be-201b-4ef7-97e8-cbe63dc5fe47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:36.486217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b60be-201b-4ef7-97e8-cbe63dc5fe47 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-400b60be-201b-4ef7-97e8-cbe63dc5fe47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:36.510308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:36.511276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:36.512156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:36.512156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:36.512156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:36.514856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 393/788] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:36.515149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 396/789] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:36.527927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e9560-9e9b-4cf1-90ba-fb07a725c39d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:36.661707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e9560-9e9b-4cf1-90ba-fb07a725c39d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:36.693659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:36.704497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4cf3a-d521-45c0-b331-a192d0e9e744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:36.705178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4cf3a-d521-45c0-b331-a192d0e9e744 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:36.705472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4cf3a-d521-45c0-b331-a192d0e9e744 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:36.705745 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4cf3a-d521-45c0-b331-a192d0e9e744 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:36.706405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4cf3a-d521-45c0-b331-a192d0e9e744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:36.706713 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4cf3a-d521-45c0-b331-a192d0e9e744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:36.708221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4cf3a-d521-45c0-b331-a192d0e9e744 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:36.725767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 394/790] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:36.731367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b60be-201b-4ef7-97e8-cbe63dc5fe47 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:36.743776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4cf3a-d521-45c0-b331-a192d0e9e744 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:36.861894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:36.893208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b60be-201b-4ef7-97e8-cbe63dc5fe47 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:36.896688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4cf3a-d521-45c0-b331-a192d0e9e744 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:36.931217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb468fb-2a13-4468-9e2b-5ddd8edfb701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:36.931811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb468fb-2a13-4468-9e2b-5ddd8edfb701 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:36.932030 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb468fb-2a13-4468-9e2b-5ddd8edfb701 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:36.932299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb468fb-2a13-4468-9e2b-5ddd8edfb701 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:36.938774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2380b3-d1bd-4d78-961f-6fbf915ef158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:36.939603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2380b3-d1bd-4d78-961f-6fbf915ef158 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:36.940399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2380b3-d1bd-4d78-961f-6fbf915ef158 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:36.940818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2380b3-d1bd-4d78-961f-6fbf915ef158 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:36.945538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb468fb-2a13-4468-9e2b-5ddd8edfb701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:36.949587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2380b3-d1bd-4d78-961f-6fbf915ef158 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-6fb468fb-2a13-4468-9e2b-5ddd8edfb701 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:36.950741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:36.951831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 395/791] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:36.953129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb468fb-2a13-4468-9e2b-5ddd8edfb701 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:36.954642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2380b3-d1bd-4d78-961f-6fbf915ef158 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-2a2380b3-d1bd-4d78-961f-6fbf915ef158 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:36.970694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:36.971675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:36.972629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:36.972629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:36.972629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:36.972629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:36.972629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:36.972629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:36.972629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:36.972629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:36.972629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:36.972629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:36.979273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 397/792] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:36.979273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2380b3-d1bd-4d78-961f-6fbf915ef158 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:37.014743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:37.080073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb468fb-2a13-4468-9e2b-5ddd8edfb701 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.109907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2380b3-d1bd-4d78-961f-6fbf915ef158 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.126856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9646242-4002-4301-a6be-a9366a54b612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:37.128125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9646242-4002-4301-a6be-a9366a54b612 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.128613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9646242-4002-4301-a6be-a9366a54b612 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.129145 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9646242-4002-4301-a6be-a9366a54b612 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.145278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8ffb0-40de-4d69-b85b-bfb8fa147f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:37.145596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9646242-4002-4301-a6be-a9366a54b612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:37.145913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8ffb0-40de-4d69-b85b-bfb8fa147f9e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.146186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8ffb0-40de-4d69-b85b-bfb8fa147f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.146453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8ffb0-40de-4d69-b85b-bfb8fa147f9e None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.147138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8ffb0-40de-4d69-b85b-bfb8fa147f9e None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:37.147436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8ffb0-40de-4d69-b85b-bfb8fa147f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:37.148858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8ffb0-40de-4d69-b85b-bfb8fa147f9e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:37.150556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c9646242-4002-4301-a6be-a9366a54b612 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:37.153604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:37.154584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:37.155434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:37.158775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 396/793] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:37.160040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9646242-4002-4301-a6be-a9366a54b612 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:37.164752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 398/794] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:37.166075 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8ffb0-40de-4d69-b85b-bfb8fa147f9e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:37.282560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8ffb0-40de-4d69-b85b-bfb8fa147f9e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.291837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9646242-4002-4301-a6be-a9366a54b612 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.301388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:37.322355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b865ec-a8e5-4c38-a5a4-e5a4744cdd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:37.322972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b865ec-a8e5-4c38-a5a4-e5a4744cdd1d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.323252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b865ec-a8e5-4c38-a5a4-e5a4744cdd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.323727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b865ec-a8e5-4c38-a5a4-e5a4744cdd1d None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.324189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b865ec-a8e5-4c38-a5a4-e5a4744cdd1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:37.324560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b865ec-a8e5-4c38-a5a4-e5a4744cdd1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:37.325891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b865ec-a8e5-4c38-a5a4-e5a4744cdd1d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:37.328474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b32d03-a5e0-430c-894e-e6a38a6c869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:37.329105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b32d03-a5e0-430c-894e-e6a38a6c869a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.329386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b32d03-a5e0-430c-894e-e6a38a6c869a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.329654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b32d03-a5e0-430c-894e-e6a38a6c869a None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.330436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b32d03-a5e0-430c-894e-e6a38a6c869a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:37.330741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b32d03-a5e0-430c-894e-e6a38a6c869a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:37.332148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b32d03-a5e0-430c-894e-e6a38a6c869a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:37.339271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 399/795] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:37.339271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b865ec-a8e5-4c38-a5a4-e5a4744cdd1d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:37.356473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 397/796] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Sep 19 16:57:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:37.357591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f84b86-bdfa-40ac-986a-072012ba7ebb None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.357874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f84b86-bdfa-40ac-986a-072012ba7ebb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.358139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f84b86-bdfa-40ac-986a-072012ba7ebb None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.363511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 398/797] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:37.364377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f84b86-bdfa-40ac-986a-072012ba7ebb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:37.398789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:37.442097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b865ec-a8e5-4c38-a5a4-e5a4744cdd1d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.470860 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f84b86-bdfa-40ac-986a-072012ba7ebb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.476953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4686b-6129-4570-bd32-966a3681b41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:37.477620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4686b-6129-4570-bd32-966a3681b41e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.477904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4686b-6129-4570-bd32-966a3681b41e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.478178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4686b-6129-4570-bd32-966a3681b41e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.490625 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4686b-6129-4570-bd32-966a3681b41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:37.492889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4686b-6129-4570-bd32-966a3681b41e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:37.506812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d041d2f-bfc4-4df4-aa39-102c1f35eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:37.507450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d041d2f-bfc4-4df4-aa39-102c1f35eea8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.507721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d041d2f-bfc4-4df4-aa39-102c1f35eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.507992 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d041d2f-bfc4-4df4-aa39-102c1f35eea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c7c4686b-6129-4570-bd32-966a3681b41e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:37.512153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:37.513094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:37.513981 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:37.513981 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:37.513981 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:37.519042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d041d2f-bfc4-4df4-aa39-102c1f35eea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:37.519174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 400/798] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:37.519979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4686b-6129-4570-bd32-966a3681b41e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:37.520776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d041d2f-bfc4-4df4-aa39-102c1f35eea8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8d041d2f-bfc4-4df4-aa39-102c1f35eea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:37.536314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:37.537302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:37.543268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:37.543268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:37.543268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:37.543268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 399/799] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:37.543268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894c6d0-36a2-4a1d-bc95-489ae8d9cb51 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.543268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894c6d0-36a2-4a1d-bc95-489ae8d9cb51 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.543268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894c6d0-36a2-4a1d-bc95-489ae8d9cb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.560337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b894c6d0-36a2-4a1d-bc95-489ae8d9cb51 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:37.561556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b894c6d0-36a2-4a1d-bc95-489ae8d9cb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:37.575395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:37.630876 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4686b-6129-4570-bd32-966a3681b41e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.645063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 400/800] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:37.645063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894c6d0-36a2-4a1d-bc95-489ae8d9cb51 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:37.649174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:37.674051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d303f-8442-49cb-b307-b8d3e39a54ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:37.674689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d303f-8442-49cb-b307-b8d3e39a54ec None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.674962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d303f-8442-49cb-b307-b8d3e39a54ec None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.675228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d303f-8442-49cb-b307-b8d3e39a54ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.685956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d303f-8442-49cb-b307-b8d3e39a54ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:37.687400 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d303f-8442-49cb-b307-b8d3e39a54ec None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a85d303f-8442-49cb-b307-b8d3e39a54ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:37.701863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:37.703020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:37.703909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:37.703909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:37.703909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:37.703909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 401/801] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:37.703909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d303f-8442-49cb-b307-b8d3e39a54ec None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:37.765057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894c6d0-36a2-4a1d-bc95-489ae8d9cb51 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.803186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d303f-8442-49cb-b307-b8d3e39a54ec None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.806361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2ffe0-edfd-4967-b9ee-5e0e451ebbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:37.807181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2ffe0-edfd-4967-b9ee-5e0e451ebbaa None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.807637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2ffe0-edfd-4967-b9ee-5e0e451ebbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.808085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2ffe0-edfd-4967-b9ee-5e0e451ebbaa None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.808983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2ffe0-edfd-4967-b9ee-5e0e451ebbaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:37.809442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2ffe0-edfd-4967-b9ee-5e0e451ebbaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:37.811062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2ffe0-edfd-4967-b9ee-5e0e451ebbaa None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:37.825418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 401/802] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:37.826290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2ffe0-edfd-4967-b9ee-5e0e451ebbaa None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:37.838294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:37.844544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb14c3c-43e0-431b-b613-aba4adc3ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:37.845428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb14c3c-43e0-431b-b613-aba4adc3ef08 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.845927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb14c3c-43e0-431b-b613-aba4adc3ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.846203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb14c3c-43e0-431b-b613-aba4adc3ef08 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.847074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb14c3c-43e0-431b-b613-aba4adc3ef08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:37.847192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb14c3c-43e0-431b-b613-aba4adc3ef08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:37.848625 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb14c3c-43e0-431b-b613-aba4adc3ef08 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:37.860808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 402/803] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:37.861794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f43a3-0ba1-40fd-8c35-95a052238ffe None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.862075 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f43a3-0ba1-40fd-8c35-95a052238ffe None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.862346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f43a3-0ba1-40fd-8c35-95a052238ffe None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.863655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 403/804] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:37.868354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f43a3-0ba1-40fd-8c35-95a052238ffe None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:37.892861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:37.938122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2ffe0-edfd-4967-b9ee-5e0e451ebbaa None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.970889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df693dba-05e8-41fb-96b6-374d293d28b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:37.971502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693dba-05e8-41fb-96b6-374d293d28b2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:37.971778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693dba-05e8-41fb-96b6-374d293d28b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:37.972049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df693dba-05e8-41fb-96b6-374d293d28b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:37.972684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df693dba-05e8-41fb-96b6-374d293d28b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:37.972981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df693dba-05e8-41fb-96b6-374d293d28b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:37.974435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df693dba-05e8-41fb-96b6-374d293d28b2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:37.974799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f43a3-0ba1-40fd-8c35-95a052238ffe None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:37.985711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 402/805] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:37.986493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df693dba-05e8-41fb-96b6-374d293d28b2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.010883 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a5910-640e-477c-a9ae-f7b42cc77494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.011513 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a5910-640e-477c-a9ae-f7b42cc77494 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.011785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a5910-640e-477c-a9ae-f7b42cc77494 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.012048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a5910-640e-477c-a9ae-f7b42cc77494 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.018845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a5910-640e-477c-a9ae-f7b42cc77494 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.020656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a5910-640e-477c-a9ae-f7b42cc77494 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e40a5910-640e-477c-a9ae-f7b42cc77494 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:38.032049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:38.033254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 404/806] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Sep 19 16:57:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:38.034418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9e0bd-6053-4984-aa89-c6c1d5d81bc2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.035219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9e0bd-6053-4984-aa89-c6c1d5d81bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.035219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9e0bd-6053-4984-aa89-c6c1d5d81bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.052636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a3e9e0bd-6053-4984-aa89-c6c1d5d81bc2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:38.053907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a3e9e0bd-6053-4984-aa89-c6c1d5d81bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:38.056910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:38.091407 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df693dba-05e8-41fb-96b6-374d293d28b2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.120949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 405/807] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:38.121817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9e0bd-6053-4984-aa89-c6c1d5d81bc2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.135766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:38.140081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2f1db-ab3e-4a63-b35a-3094a0dc999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.140738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2f1db-ab3e-4a63-b35a-3094a0dc999a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.140996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2f1db-ab3e-4a63-b35a-3094a0dc999a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.141377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2f1db-ab3e-4a63-b35a-3094a0dc999a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.150572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2f1db-ab3e-4a63-b35a-3094a0dc999a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.150947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2f1db-ab3e-4a63-b35a-3094a0dc999a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a6a2f1db-ab3e-4a63-b35a-3094a0dc999a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:38.163072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:38.164022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:38.164963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 403/808] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Sep 19 16:57:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:38.165595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2f1db-ab3e-4a63-b35a-3094a0dc999a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.233613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9e0bd-6053-4984-aa89-c6c1d5d81bc2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.266638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f4086-a369-4956-8d91-839e7b445ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.267274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f4086-a369-4956-8d91-839e7b445ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.267551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f4086-a369-4956-8d91-839e7b445ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.267821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f4086-a369-4956-8d91-839e7b445ce8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.267921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2f1db-ab3e-4a63-b35a-3094a0dc999a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.268405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f4086-a369-4956-8d91-839e7b445ce8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.270272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f4086-a369-4956-8d91-839e7b445ce8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6c6f4086-a369-4956-8d91-839e7b445ce8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:38.279017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:38.280025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:38.280852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 406/809] 10.222.0.76 () {56 vars in 1129 bytes} [Mon Sep 19 16:57:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:38.281779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f4086-a369-4956-8d91-839e7b445ce8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.302004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:38.311553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad5527-5401-4c1f-b352-33e0b2d21d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.312125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad5527-5401-4c1f-b352-33e0b2d21d1d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.312411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad5527-5401-4c1f-b352-33e0b2d21d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.312681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad5527-5401-4c1f-b352-33e0b2d21d1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.319440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad5527-5401-4c1f-b352-33e0b2d21d1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.320875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad5527-5401-4c1f-b352-33e0b2d21d1d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-4bad5527-5401-4c1f-b352-33e0b2d21d1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:38.331885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:38.332892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:38.333864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:38.333864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:38.333864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:38.333864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:38.333864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:38.333864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:38.333864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:38.333864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:38.337948 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 404/810] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:38.338782 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad5527-5401-4c1f-b352-33e0b2d21d1d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.359430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:38.383539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f4086-a369-4956-8d91-839e7b445ce8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.416982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1b24-5cc2-497b-8032-91cbb18fc837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.417624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1b24-5cc2-497b-8032-91cbb18fc837 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.417908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1b24-5cc2-497b-8032-91cbb18fc837 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.418180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1b24-5cc2-497b-8032-91cbb18fc837 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.418911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1b24-5cc2-497b-8032-91cbb18fc837 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:38.419219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1b24-5cc2-497b-8032-91cbb18fc837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.420659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1b24-5cc2-497b-8032-91cbb18fc837 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.438278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 407/811] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Sep 19 16:57:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:38.439066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1b24-5cc2-497b-8032-91cbb18fc837 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.443342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad5527-5401-4c1f-b352-33e0b2d21d1d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.476221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7f6c4-c67f-4d57-b107-c67f4f188b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.476828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7f6c4-c67f-4d57-b107-c67f4f188b50 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.477137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7f6c4-c67f-4d57-b107-c67f4f188b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.477414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7f6c4-c67f-4d57-b107-c67f4f188b50 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.478142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7f6c4-c67f-4d57-b107-c67f4f188b50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:38.478446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7f6c4-c67f-4d57-b107-c67f4f188b50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.480266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7f6c4-c67f-4d57-b107-c67f4f188b50 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.496536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 405/812] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Sep 19 16:57:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:38.497357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7f6c4-c67f-4d57-b107-c67f4f188b50 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.540793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:38.541585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1b24-5cc2-497b-8032-91cbb18fc837 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.576014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6b6dd-a80c-4e8c-a81e-a723128fd837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.576541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6b6dd-a80c-4e8c-a81e-a723128fd837 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.576820 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6b6dd-a80c-4e8c-a81e-a723128fd837 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.577116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6b6dd-a80c-4e8c-a81e-a723128fd837 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.577759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6b6dd-a80c-4e8c-a81e-a723128fd837 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:38.578060 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6b6dd-a80c-4e8c-a81e-a723128fd837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.579426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6b6dd-a80c-4e8c-a81e-a723128fd837 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.580706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:38.585329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 408/813] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Sep 19 16:57:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:38.586003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6b6dd-a80c-4e8c-a81e-a723128fd837 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.595654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7f6c4-c67f-4d57-b107-c67f4f188b50 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.627884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4292898-e28a-4e67-b2fd-275b4fc108e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.628497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4292898-e28a-4e67-b2fd-275b4fc108e1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.628772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4292898-e28a-4e67-b2fd-275b4fc108e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.629057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4292898-e28a-4e67-b2fd-275b4fc108e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.629836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4292898-e28a-4e67-b2fd-275b4fc108e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:38.630141 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4292898-e28a-4e67-b2fd-275b4fc108e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.631582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4292898-e28a-4e67-b2fd-275b4fc108e1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.643096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 406/814] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:38.643892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4292898-e28a-4e67-b2fd-275b4fc108e1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.686584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6b6dd-a80c-4e8c-a81e-a723128fd837 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.720416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45994040-4c66-4e2b-a7b5-4493c06aaf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.721069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45994040-4c66-4e2b-a7b5-4493c06aaf35 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.721354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45994040-4c66-4e2b-a7b5-4493c06aaf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.721632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45994040-4c66-4e2b-a7b5-4493c06aaf35 None admin] PATH_INFO: `/v3/services/network` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.722215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45994040-4c66-4e2b-a7b5-4493c06aaf35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.723719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45994040-4c66-4e2b-a7b5-4493c06aaf35 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-45994040-4c66-4e2b-a7b5-4493c06aaf35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:38.732368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:38.733541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:38.734540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 409/815] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:38 2022] GET /identity/v3/services/network => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:38.735503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45994040-4c66-4e2b-a7b5-4493c06aaf35 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.744643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4292898-e28a-4e67-b2fd-275b4fc108e1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.751689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:38.779228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa607-593d-4b72-8728-6fac523e3073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.779856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa607-593d-4b72-8728-6fac523e3073 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.780130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa607-593d-4b72-8728-6fac523e3073 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.780403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aa607-593d-4b72-8728-6fac523e3073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.790598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa607-593d-4b72-8728-6fac523e3073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.792029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52aa607-593d-4b72-8728-6fac523e3073 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.795615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-d52aa607-593d-4b72-8728-6fac523e3073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:38.806618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:38.807750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:38.808643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:38.808643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:38.808643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:38.808643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 407/816] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:38.808862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa607-593d-4b72-8728-6fac523e3073 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.834853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45994040-4c66-4e2b-a7b5-4493c06aaf35 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.867859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380618d-d38d-4a23-931d-8050934c5667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.868468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380618d-d38d-4a23-931d-8050934c5667 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.868748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380618d-d38d-4a23-931d-8050934c5667 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.869020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380618d-d38d-4a23-931d-8050934c5667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.909391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aa607-593d-4b72-8728-6fac523e3073 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:38.934893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380618d-d38d-4a23-931d-8050934c5667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.936530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380618d-d38d-4a23-931d-8050934c5667 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.942006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe5a73-a6a5-4ae3-b284-7095562fb43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:38.942617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe5a73-a6a5-4ae3-b284-7095562fb43a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:38.942893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe5a73-a6a5-4ae3-b284-7095562fb43a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:38.943157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe5a73-a6a5-4ae3-b284-7095562fb43a None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:38.943782 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe5a73-a6a5-4ae3-b284-7095562fb43a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:38.944080 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe5a73-a6a5-4ae3-b284-7095562fb43a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:38.945467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe5a73-a6a5-4ae3-b284-7095562fb43a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:38.950340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 408/817] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Sep 19 16:57:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:38.951098 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe5a73-a6a5-4ae3-b284-7095562fb43a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:38.979340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:38.995307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:39.034543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 410/818] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:57:39.035543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380618d-d38d-4a23-931d-8050934c5667 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:39.053314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe5a73-a6a5-4ae3-b284-7095562fb43a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:39.085684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d898b-3a06-41c6-b34f-b73ee76ddbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:39.086270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d898b-3a06-41c6-b34f-b73ee76ddbb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:39.086545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d898b-3a06-41c6-b34f-b73ee76ddbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:39.086814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d898b-3a06-41c6-b34f-b73ee76ddbb2 None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/8834ef19c2604e8c828aa4dd32db61a7/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:39.088684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d898b-3a06-41c6-b34f-b73ee76ddbb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=8834ef19c2604e8c828aa4dd32db61a7, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:39.090169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d898b-3a06-41c6-b34f-b73ee76ddbb2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:39.103494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 409/819] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:57:38 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/8834ef19c2604e8c828aa4dd32db61a7/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:57:39.104326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d898b-3a06-41c6-b34f-b73ee76ddbb2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:39.139404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380618d-d38d-4a23-931d-8050934c5667 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:39.188025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e11ad8-f74e-43f5-a6af-ee2ce66e4a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:39.188679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e11ad8-f74e-43f5-a6af-ee2ce66e4a85 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:39.188947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e11ad8-f74e-43f5-a6af-ee2ce66e4a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:39.189250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e11ad8-f74e-43f5-a6af-ee2ce66e4a85 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:39.189911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e11ad8-f74e-43f5-a6af-ee2ce66e4a85 None admin] RBAC: Adding query filter params (name=network) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:39.190216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e11ad8-f74e-43f5-a6af-ee2ce66e4a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:39.191618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e11ad8-f74e-43f5-a6af-ee2ce66e4a85 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:39.197552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 411/820] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:57:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:39.198492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e11ad8-f74e-43f5-a6af-ee2ce66e4a85 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:39.210618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:39.229775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:39.234427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d898b-3a06-41c6-b34f-b73ee76ddbb2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:39.277635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009b9a6-2eac-4bdf-bf33-69fcd5474897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:39.279512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009b9a6-2eac-4bdf-bf33-69fcd5474897 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:39.280007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009b9a6-2eac-4bdf-bf33-69fcd5474897 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:39.280428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009b9a6-2eac-4bdf-bf33-69fcd5474897 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:39.281269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009b9a6-2eac-4bdf-bf33-69fcd5474897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:39.281575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009b9a6-2eac-4bdf-bf33-69fcd5474897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:39.283565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009b9a6-2eac-4bdf-bf33-69fcd5474897 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:39.301868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 410/821] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:39.302709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009b9a6-2eac-4bdf-bf33-69fcd5474897 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:39.319192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e11ad8-f74e-43f5-a6af-ee2ce66e4a85 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:39.354761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500d2fd-5935-4be5-87e7-88ce163d12bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:39.355295 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500d2fd-5935-4be5-87e7-88ce163d12bd None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:39.355584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500d2fd-5935-4be5-87e7-88ce163d12bd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:39.355829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500d2fd-5935-4be5-87e7-88ce163d12bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:39.356493 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500d2fd-5935-4be5-87e7-88ce163d12bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:39.357893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500d2fd-5935-4be5-87e7-88ce163d12bd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:39.380268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 412/822] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 16:57:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:39.385614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500d2fd-5935-4be5-87e7-88ce163d12bd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:39.425218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009b9a6-2eac-4bdf-bf33-69fcd5474897 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:39.470193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dfe7a-c80a-41b7-bb7b-001d4e83821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:39.471217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfe7a-c80a-41b7-bb7b-001d4e83821f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:39.471698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfe7a-c80a-41b7-bb7b-001d4e83821f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:39.472203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dfe7a-c80a-41b7-bb7b-001d4e83821f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:39.480491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:39.483425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:39.486461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dfe7a-c80a-41b7-bb7b-001d4e83821f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:39.488485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dfe7a-c80a-41b7-bb7b-001d4e83821f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-870dfe7a-c80a-41b7-bb7b-001d4e83821f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:39.504827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:39.506066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:39.507158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:39.507158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:39.507158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:39.508951 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 411/823] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:39.510085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dfe7a-c80a-41b7-bb7b-001d4e83821f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:39.510538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500d2fd-5935-4be5-87e7-88ce163d12bd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:39.558191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8745d1-2d32-4a9d-a9e6-48955b2d62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:39.559033 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8745d1-2d32-4a9d-a9e6-48955b2d62ce None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:39.559404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8745d1-2d32-4a9d-a9e6-48955b2d62ce None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:39.560170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8745d1-2d32-4a9d-a9e6-48955b2d62ce None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:39.560948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8745d1-2d32-4a9d-a9e6-48955b2d62ce None admin] RBAC: Adding query filter params (type=network) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:39.561633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8745d1-2d32-4a9d-a9e6-48955b2d62ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:39.563411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8745d1-2d32-4a9d-a9e6-48955b2d62ce None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:39.570810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 413/824] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:57:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:39.572365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8745d1-2d32-4a9d-a9e6-48955b2d62ce None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:39.643486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dfe7a-c80a-41b7-bb7b-001d4e83821f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:39.683016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b39804-b789-46a2-8a3b-5c1fa1fb0654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:39.683964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b39804-b789-46a2-8a3b-5c1fa1fb0654 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:39.684415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b39804-b789-46a2-8a3b-5c1fa1fb0654 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:39.684858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b39804-b789-46a2-8a3b-5c1fa1fb0654 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:39.693268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b39804-b789-46a2-8a3b-5c1fa1fb0654 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:39.695137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b39804-b789-46a2-8a3b-5c1fa1fb0654 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:39.701495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8745d1-2d32-4a9d-a9e6-48955b2d62ce None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f8b39804-b789-46a2-8a3b-5c1fa1fb0654 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:39.709305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:39.710180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:39.711055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:39.711055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:39.711055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:39.711055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:39.711055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:39.711055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:39.711055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:39.711055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:39.713945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 412/825] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:39.714850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b39804-b789-46a2-8a3b-5c1fa1fb0654 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:39.744630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72c34-c43c-4f2d-b02a-71fa22eba4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:39.745820 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72c34-c43c-4f2d-b02a-71fa22eba4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:39.746467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72c34-c43c-4f2d-b02a-71fa22eba4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:39.746880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72c34-c43c-4f2d-b02a-71fa22eba4c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:39.748206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72c34-c43c-4f2d-b02a-71fa22eba4c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:39.748750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72c34-c43c-4f2d-b02a-71fa22eba4c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:39.750319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72c34-c43c-4f2d-b02a-71fa22eba4c9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:39.767467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:39.767900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 414/826] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:39.768900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72c34-c43c-4f2d-b02a-71fa22eba4c9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:39.781268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:39.831098 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b39804-b789-46a2-8a3b-5c1fa1fb0654 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:39.867354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deda31-d2bc-4926-ae7b-b45396d69ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:39.868535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deda31-d2bc-4926-ae7b-b45396d69ad2 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:39.869128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deda31-d2bc-4926-ae7b-b45396d69ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:39.869660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deda31-d2bc-4926-ae7b-b45396d69ad2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:39.871167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78deda31-d2bc-4926-ae7b-b45396d69ad2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:39.873378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78deda31-d2bc-4926-ae7b-b45396d69ad2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:39.887365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72c34-c43c-4f2d-b02a-71fa22eba4c9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:39.903370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 413/827] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 16:57:39 2022] POST /identity/v3/endpoints => generated 337 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:39.904407 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deda31-d2bc-4926-ae7b-b45396d69ad2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:39.931931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9b902-fdbe-4905-9fa8-6f30c9b7e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:39.932908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b902-fdbe-4905-9fa8-6f30c9b7e4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:39.933391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b902-fdbe-4905-9fa8-6f30c9b7e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:39.933833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9b902-fdbe-4905-9fa8-6f30c9b7e4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:39.934797 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9b902-fdbe-4905-9fa8-6f30c9b7e4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:39.935617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9b902-fdbe-4905-9fa8-6f30c9b7e4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:39.937310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9b902-fdbe-4905-9fa8-6f30c9b7e4b5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:39.951014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 415/828] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:39.960265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9b902-fdbe-4905-9fa8-6f30c9b7e4b5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:40.063766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deda31-d2bc-4926-ae7b-b45396d69ad2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:40.074836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:40.087846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:40.129885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3c11c-6515-4c8e-8956-ecf442ec5dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:40.130875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c11c-6515-4c8e-8956-ecf442ec5dbd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:40.131348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c11c-6515-4c8e-8956-ecf442ec5dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:40.131843 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c11c-6515-4c8e-8956-ecf442ec5dbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:40.138619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9b902-fdbe-4905-9fa8-6f30c9b7e4b5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:40.145257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3c11c-6515-4c8e-8956-ecf442ec5dbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:40.146858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3c11c-6515-4c8e-8956-ecf442ec5dbd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c5a3c11c-6515-4c8e-8956-ecf442ec5dbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:40.173212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:40.174149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:40.175528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:40.175528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:40.175528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:40.175528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:40.175528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:40.175528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:40.175528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:40.175528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:40.175528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 414/829] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:40.180498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3c11c-6515-4c8e-8956-ecf442ec5dbd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:40.181218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa152a-255a-4270-b2b3-33df05ab2c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:40.182047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa152a-255a-4270-b2b3-33df05ab2c37 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:40.182394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa152a-255a-4270-b2b3-33df05ab2c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:40.182735 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa152a-255a-4270-b2b3-33df05ab2c37 None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/ee58334347c34e329ac250ae9e73aa93/roles/0af1ff2cf6f948529ec7cece6eca90d4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:40.201752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa152a-255a-4270-b2b3-33df05ab2c37 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=ee58334347c34e329ac250ae9e73aa93, role_id=0af1ff2cf6f948529ec7cece6eca90d4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:40.203575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa152a-255a-4270-b2b3-33df05ab2c37 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:40.221896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 416/830] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:57:39 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/ee58334347c34e329ac250ae9e73aa93/roles/0af1ff2cf6f948529ec7cece6eca90d4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:57:40.334823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3c11c-6515-4c8e-8956-ecf442ec5dbd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:40.372876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e18ed6-2564-4d04-bd14-b2cc17ffeccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:40.373550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e18ed6-2564-4d04-bd14-b2cc17ffeccd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:40.373827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e18ed6-2564-4d04-bd14-b2cc17ffeccd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:40.374146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e18ed6-2564-4d04-bd14-b2cc17ffeccd None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:40.374869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e18ed6-2564-4d04-bd14-b2cc17ffeccd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:40.375173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e18ed6-2564-4d04-bd14-b2cc17ffeccd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:40.376652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e18ed6-2564-4d04-bd14-b2cc17ffeccd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:40.391425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 415/831] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:40.398300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa152a-255a-4270-b2b3-33df05ab2c37 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:40.507194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa152a-255a-4270-b2b3-33df05ab2c37 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:40.522307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:40.544238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae211c3-606c-4606-913a-fde6d11b46c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:40.544859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae211c3-606c-4606-913a-fde6d11b46c7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:40.545170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae211c3-606c-4606-913a-fde6d11b46c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:40.545440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae211c3-606c-4606-913a-fde6d11b46c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:40.546171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae211c3-606c-4606-913a-fde6d11b46c7 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=ea18c782ddf2469fa3d10a135fc34c37) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:40.546476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae211c3-606c-4606-913a-fde6d11b46c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:40.547918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae211c3-606c-4606-913a-fde6d11b46c7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:40.554325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 417/832] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:40 2022] GET /identity/v3/role_assignments?user.id=ea18c782ddf2469fa3d10a135fc34c37&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=77285ef607e34662b6234656fe8043d0 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:41.323743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264326c9-81ce-4b07-93b5-47689954660a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:41.324442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264326c9-81ce-4b07-93b5-47689954660a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:41.324442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264326c9-81ce-4b07-93b5-47689954660a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:41.325859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 416/833] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:41.331259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de27da-cf7f-497c-8647-e0bf23061403 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:41.331736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de27da-cf7f-497c-8647-e0bf23061403 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:41.331887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de27da-cf7f-497c-8647-e0bf23061403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:41.350544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c8de27da-cf7f-497c-8647-e0bf23061403 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:41.351709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c8de27da-cf7f-497c-8647-e0bf23061403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:41.420196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 418/834] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:41.681469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264326c9-81ce-4b07-93b5-47689954660a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:41.709066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:41.774788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc93f4e-2a99-46cf-a2c8-24a93ff6d89f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:41.775453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc93f4e-2a99-46cf-a2c8-24a93ff6d89f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:41.775945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc93f4e-2a99-46cf-a2c8-24a93ff6d89f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:41.778946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 419/835] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:41.782986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750918c-9863-4ce4-a993-5c074f3bec0c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:41.783483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750918c-9863-4ce4-a993-5c074f3bec0c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:41.783971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750918c-9863-4ce4-a993-5c074f3bec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:41.786221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264326c9-81ce-4b07-93b5-47689954660a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:41.811653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7750918c-9863-4ce4-a993-5c074f3bec0c None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:41.813529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7750918c-9863-4ce4-a993-5c074f3bec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:41.824652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b10ff5-a3e8-4bee-bd98-9331b2c3fcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:41.825631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b10ff5-a3e8-4bee-bd98-9331b2c3fcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:41.826113 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b10ff5-a3e8-4bee-bd98-9331b2c3fcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:41.826580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b10ff5-a3e8-4bee-bd98-9331b2c3fcb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:41.839342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b10ff5-a3e8-4bee-bd98-9331b2c3fcb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a7b10ff5-a3e8-4bee-bd98-9331b2c3fcb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:41.844727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:41.845678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:57:41.846521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:41.849296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 417/836] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:41.857162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b10ff5-a3e8-4bee-bd98-9331b2c3fcb9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:41.886614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 420/837] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:57:41.948645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:41.965399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b10ff5-a3e8-4bee-bd98-9331b2c3fcb9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:41.999974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22573a-749b-4f82-8ef2-8b06e6fba8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:42.000821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22573a-749b-4f82-8ef2-8b06e6fba8ed None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.001271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22573a-749b-4f82-8ef2-8b06e6fba8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.001680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22573a-749b-4f82-8ef2-8b06e6fba8ed None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.002496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22573a-749b-4f82-8ef2-8b06e6fba8ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:42.002938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22573a-749b-4f82-8ef2-8b06e6fba8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:42.004453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22573a-749b-4f82-8ef2-8b06e6fba8ed None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:42.013220 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 418/838] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:42.019116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750918c-9863-4ce4-a993-5c074f3bec0c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:42.054116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:42.120883 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750918c-9863-4ce4-a993-5c074f3bec0c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:42.160980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1678e-a1c9-4ff9-bc9d-cc0e88ff3f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:42.161604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1678e-a1c9-4ff9-bc9d-cc0e88ff3f43 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.161881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1678e-a1c9-4ff9-bc9d-cc0e88ff3f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.162153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1678e-a1c9-4ff9-bc9d-cc0e88ff3f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.162850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22573a-749b-4f82-8ef2-8b06e6fba8ed None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:42.172766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1678e-a1c9-4ff9-bc9d-cc0e88ff3f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:42.174256 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1678e-a1c9-4ff9-bc9d-cc0e88ff3f43 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-44c1678e-a1c9-4ff9-bc9d-cc0e88ff3f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:42.189270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:42.190254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:42.191416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:42.191416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:42.191416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:42.191416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 421/839] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:42.196703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1678e-a1c9-4ff9-bc9d-cc0e88ff3f43 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:42.275795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22573a-749b-4f82-8ef2-8b06e6fba8ed None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:42.309998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:42.314486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ddcf9-0bd2-41c5-8464-31a7e4826470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:42.315397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ddcf9-0bd2-41c5-8464-31a7e4826470 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.315839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ddcf9-0bd2-41c5-8464-31a7e4826470 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.316386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ddcf9-0bd2-41c5-8464-31a7e4826470 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.317390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ddcf9-0bd2-41c5-8464-31a7e4826470 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:42.320000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ddcf9-0bd2-41c5-8464-31a7e4826470 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:42.322564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1678e-a1c9-4ff9-bc9d-cc0e88ff3f43 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7f6ddcf9-0bd2-41c5-8464-31a7e4826470 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:42.330091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:42.331398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:57:42.332228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:42.339942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 419/840] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:57:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:42.341475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ddcf9-0bd2-41c5-8464-31a7e4826470 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:42.358114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:42.360890 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e602333-408d-4320-bfbd-208943310a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:42.361570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e602333-408d-4320-bfbd-208943310a97 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.361850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e602333-408d-4320-bfbd-208943310a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.362134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e602333-408d-4320-bfbd-208943310a97 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.362786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e602333-408d-4320-bfbd-208943310a97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:42.363094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e602333-408d-4320-bfbd-208943310a97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:42.364826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e602333-408d-4320-bfbd-208943310a97 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:42.380198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 422/841] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:42.385762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e602333-408d-4320-bfbd-208943310a97 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:42.465522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ddcf9-0bd2-41c5-8464-31a7e4826470 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:42.505575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e602333-408d-4320-bfbd-208943310a97 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:42.508144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be97c5-563f-42d7-9744-3f9f03218d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:42.508770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be97c5-563f-42d7-9744-3f9f03218d05 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.509874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be97c5-563f-42d7-9744-3f9f03218d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.510169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be97c5-563f-42d7-9744-3f9f03218d05 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.510816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be97c5-563f-42d7-9744-3f9f03218d05 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:42.511122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be97c5-563f-42d7-9744-3f9f03218d05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:42.512591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be97c5-563f-42d7-9744-3f9f03218d05 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:42.518337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 420/842] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:57:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:42.520239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45141-cfd3-49a1-a0c2-6f3e28c2c859 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.520794 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45141-cfd3-49a1-a0c2-6f3e28c2c859 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.521089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45141-cfd3-49a1-a0c2-6f3e28c2c859 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.522816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 421/843] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:42.527571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d45141-cfd3-49a1-a0c2-6f3e28c2c859 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:42.543659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b510b8-7661-471b-bd9a-31fad7e6b5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:42.544300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b510b8-7661-471b-bd9a-31fad7e6b5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.544572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b510b8-7661-471b-bd9a-31fad7e6b5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.544936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b510b8-7661-471b-bd9a-31fad7e6b5a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.552110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b510b8-7661-471b-bd9a-31fad7e6b5a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:42.553591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b510b8-7661-471b-bd9a-31fad7e6b5a4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e2b510b8-7661-471b-bd9a-31fad7e6b5a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:42.565114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:42.566101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:42.567080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 423/844] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:57:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:42.568278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dd244-6cdf-4b93-b89d-78186c666bdf None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.568278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dd244-6cdf-4b93-b89d-78186c666bdf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.568434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dd244-6cdf-4b93-b89d-78186c666bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.587882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-814dd244-6cdf-4b93-b89d-78186c666bdf None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:42.589324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-814dd244-6cdf-4b93-b89d-78186c666bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:42.591104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:42.617766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:42.643555 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d45141-cfd3-49a1-a0c2-6f3e28c2c859 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:42.660215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 424/845] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:42.661396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dd244-6cdf-4b93-b89d-78186c666bdf None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:42.687903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e4839-c7b5-45a3-b415-81e12fe9f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:42.688688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e4839-c7b5-45a3-b415-81e12fe9f0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.689083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e4839-c7b5-45a3-b415-81e12fe9f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.689628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e4839-c7b5-45a3-b415-81e12fe9f0d7 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.690415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e4839-c7b5-45a3-b415-81e12fe9f0d7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:42.690822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e4839-c7b5-45a3-b415-81e12fe9f0d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:42.692573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e4839-c7b5-45a3-b415-81e12fe9f0d7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:42.698573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 422/846] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:57:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:42.786522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dd244-6cdf-4b93-b89d-78186c666bdf None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:42.829570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec1178-55c7-49b8-93e8-5b0b8aa1cc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:42.830195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec1178-55c7-49b8-93e8-5b0b8aa1cc94 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.830472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec1178-55c7-49b8-93e8-5b0b8aa1cc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.830743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec1178-55c7-49b8-93e8-5b0b8aa1cc94 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.831499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec1178-55c7-49b8-93e8-5b0b8aa1cc94 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:42.831802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec1178-55c7-49b8-93e8-5b0b8aa1cc94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:42.833361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec1178-55c7-49b8-93e8-5b0b8aa1cc94 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:42.838620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb904b0-f67a-4d4f-bb33-8d52f3d45fd7 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.838938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb904b0-f67a-4d4f-bb33-8d52f3d45fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.839169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb904b0-f67a-4d4f-bb33-8d52f3d45fd7 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.840836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 423/847] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:42.843020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:42.846500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe568-1c8b-4d3a-a22b-dc5369306a67 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:42.846784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe568-1c8b-4d3a-a22b-dc5369306a67 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:42.847057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe568-1c8b-4d3a-a22b-dc5369306a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:42.855964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 425/848] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Sep 19 16:57:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:42.863566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec1178-55c7-49b8-93e8-5b0b8aa1cc94 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:42.869544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-affbe568-1c8b-4d3a-a22b-dc5369306a67 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:42.870774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-affbe568-1c8b-4d3a-a22b-dc5369306a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:42.943702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 424/849] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:42.969896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec1178-55c7-49b8-93e8-5b0b8aa1cc94 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:42.977380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbe568-1c8b-4d3a-a22b-dc5369306a67 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:43.005850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde99d-1d6f-4c28-bbc8-5cc4ef300444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:43.006706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde99d-1d6f-4c28-bbc8-5cc4ef300444 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:43.007054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde99d-1d6f-4c28-bbc8-5cc4ef300444 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:43.007504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcde99d-1d6f-4c28-bbc8-5cc4ef300444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:43.046197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:43.077574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbe568-1c8b-4d3a-a22b-dc5369306a67 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:43.079912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcde99d-1d6f-4c28-bbc8-5cc4ef300444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:43.081644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcde99d-1d6f-4c28-bbc8-5cc4ef300444 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:43.085370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:43.111928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6d469-f8ef-4b1b-baeb-5769a2b3bda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:43.112499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6d469-f8ef-4b1b-baeb-5769a2b3bda5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:43.112774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6d469-f8ef-4b1b-baeb-5769a2b3bda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:43.113070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6d469-f8ef-4b1b-baeb-5769a2b3bda5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:43.123236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6d469-f8ef-4b1b-baeb-5769a2b3bda5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-bdd6d469-f8ef-4b1b-baeb-5769a2b3bda5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:43.127931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:43.128833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:43.130383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 425/850] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 16:57:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:43.135967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6d469-f8ef-4b1b-baeb-5769a2b3bda5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:43.199610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 426/851] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:42 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 16:57:43.204916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde99d-1d6f-4c28-bbc8-5cc4ef300444 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:43.252680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6d469-f8ef-4b1b-baeb-5769a2b3bda5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:43.281423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:43.288078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792208aa-20bb-4c7b-a3a5-de64ba27cd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:43.288696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792208aa-20bb-4c7b-a3a5-de64ba27cd58 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:43.288975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792208aa-20bb-4c7b-a3a5-de64ba27cd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:43.289278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792208aa-20bb-4c7b-a3a5-de64ba27cd58 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:43.289950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792208aa-20bb-4c7b-a3a5-de64ba27cd58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:43.290249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792208aa-20bb-4c7b-a3a5-de64ba27cd58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:43.291625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792208aa-20bb-4c7b-a3a5-de64ba27cd58 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:43.304633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 426/852] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 16:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:43.304633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792208aa-20bb-4c7b-a3a5-de64ba27cd58 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:43.309559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:43.317359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcde99d-1d6f-4c28-bbc8-5cc4ef300444 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:43.352785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b704b53-7a1d-4621-806f-5c948e534b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:43.353464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704b53-7a1d-4621-806f-5c948e534b3b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:43.353747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704b53-7a1d-4621-806f-5c948e534b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:43.354019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704b53-7a1d-4621-806f-5c948e534b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:43.368445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b704b53-7a1d-4621-806f-5c948e534b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:43.370322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b704b53-7a1d-4621-806f-5c948e534b3b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-1b704b53-7a1d-4621-806f-5c948e534b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:43.385806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:43.386872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:43.387762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:43.387762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:43.387762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:43.391540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 427/853] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:43.392305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b704b53-7a1d-4621-806f-5c948e534b3b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:43.424633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792208aa-20bb-4c7b-a3a5-de64ba27cd58 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:43.464927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c1ae6-fffd-4d97-86ff-3bff872db770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:43.465610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c1ae6-fffd-4d97-86ff-3bff872db770 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:43.465895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c1ae6-fffd-4d97-86ff-3bff872db770 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:43.466166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c1ae6-fffd-4d97-86ff-3bff872db770 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:43.466760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c1ae6-fffd-4d97-86ff-3bff872db770 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:43.468155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c1ae6-fffd-4d97-86ff-3bff872db770 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-802c1ae6-fffd-4d97-86ff-3bff872db770 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:43.478082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:43.479079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:43.481891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 427/854] 10.222.0.76 () {56 vars in 1132 bytes} [Mon Sep 19 16:57:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:43.482687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c1ae6-fffd-4d97-86ff-3bff872db770 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:43.545286 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:43.593912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c1ae6-fffd-4d97-86ff-3bff872db770 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:43.624310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b704b53-7a1d-4621-806f-5c948e534b3b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:43.633371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1ae25-17d2-405d-bedd-7070533e9121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:43.633983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1ae25-17d2-405d-bedd-7070533e9121 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:43.634265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1ae25-17d2-405d-bedd-7070533e9121 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:43.634534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1ae25-17d2-405d-bedd-7070533e9121 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:43.635279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1ae25-17d2-405d-bedd-7070533e9121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:43.635470 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1ae25-17d2-405d-bedd-7070533e9121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:43.637215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1ae25-17d2-405d-bedd-7070533e9121 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:43.656058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 428/855] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:43.658865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1ae25-17d2-405d-bedd-7070533e9121 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:43.662640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b5824-26d3-43bd-95b3-8c370752190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:43.663280 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b5824-26d3-43bd-95b3-8c370752190c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:43.663558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b5824-26d3-43bd-95b3-8c370752190c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:43.663830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b5824-26d3-43bd-95b3-8c370752190c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:43.674084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b5824-26d3-43bd-95b3-8c370752190c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:43.675565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b5824-26d3-43bd-95b3-8c370752190c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:43.684336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ec2b5824-26d3-43bd-95b3-8c370752190c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:43.691211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:43.692216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:43.693142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:43.693142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:43.693142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:43.694625 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 428/856] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:43.695533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b5824-26d3-43bd-95b3-8c370752190c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:43.775581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1ae25-17d2-405d-bedd-7070533e9121 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:43.796173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:43.803035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b5824-26d3-43bd-95b3-8c370752190c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:43.818380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049f245-7acd-4991-aa66-8178f2d44ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:43.819063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f245-7acd-4991-aa66-8178f2d44ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:43.819343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f245-7acd-4991-aa66-8178f2d44ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:43.819612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049f245-7acd-4991-aa66-8178f2d44ef4 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:43.820238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049f245-7acd-4991-aa66-8178f2d44ef4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:43.820539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049f245-7acd-4991-aa66-8178f2d44ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:43.821928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049f245-7acd-4991-aa66-8178f2d44ef4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:43.831093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 429/857] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:57:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:43.831093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049f245-7acd-4991-aa66-8178f2d44ef4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:43.841386 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fce7c-0a2a-4840-8e2e-1b3d34aad8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:43.842025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fce7c-0a2a-4840-8e2e-1b3d34aad8cd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:43.842305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fce7c-0a2a-4840-8e2e-1b3d34aad8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:43.842579 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fce7c-0a2a-4840-8e2e-1b3d34aad8cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:43.851608 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fce7c-0a2a-4840-8e2e-1b3d34aad8cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:43.852972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fce7c-0a2a-4840-8e2e-1b3d34aad8cd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-192fce7c-0a2a-4840-8e2e-1b3d34aad8cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:43.865817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:43.866739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:43.867680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:43.867680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:43.867680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:43.867680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:43.867680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:43.867680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:43.867680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:43.867680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:43.867680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 429/858] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:43.867680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fce7c-0a2a-4840-8e2e-1b3d34aad8cd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:43.931127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:43.938752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049f245-7acd-4991-aa66-8178f2d44ef4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:43.977728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72388ba-63ab-4470-81da-476b310d4cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:43.978359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72388ba-63ab-4470-81da-476b310d4cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:43.978760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72388ba-63ab-4470-81da-476b310d4cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:43.979214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72388ba-63ab-4470-81da-476b310d4cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:43.980313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72388ba-63ab-4470-81da-476b310d4cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:43.980811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72388ba-63ab-4470-81da-476b310d4cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:43.983086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72388ba-63ab-4470-81da-476b310d4cb6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:43.986719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fce7c-0a2a-4840-8e2e-1b3d34aad8cd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:44.000731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 430/859] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:44.002005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72388ba-63ab-4470-81da-476b310d4cb6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:44.030455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4d654-89b1-43df-90c6-792dcbaa2f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:44.031475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4d654-89b1-43df-90c6-792dcbaa2f35 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:44.031835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4d654-89b1-43df-90c6-792dcbaa2f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:44.032086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4d654-89b1-43df-90c6-792dcbaa2f35 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:44.032716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4d654-89b1-43df-90c6-792dcbaa2f35 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:44.033011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4d654-89b1-43df-90c6-792dcbaa2f35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:44.034496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4d654-89b1-43df-90c6-792dcbaa2f35 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:44.049068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 430/860] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:57:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:44.049068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4d654-89b1-43df-90c6-792dcbaa2f35 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:44.071919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:44.152563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72388ba-63ab-4470-81da-476b310d4cb6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:44.195566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cad73-05ff-42e6-8d87-fbac204051f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:44.196591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cad73-05ff-42e6-8d87-fbac204051f2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:44.197136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cad73-05ff-42e6-8d87-fbac204051f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:44.197663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cad73-05ff-42e6-8d87-fbac204051f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:44.198705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cad73-05ff-42e6-8d87-fbac204051f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:44.199236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cad73-05ff-42e6-8d87-fbac204051f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:44.200897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cad73-05ff-42e6-8d87-fbac204051f2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:44.201025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4d654-89b1-43df-90c6-792dcbaa2f35 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:44.221001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 431/861] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:44.222454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cad73-05ff-42e6-8d87-fbac204051f2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:44.230409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:44.244071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cd625-56a5-40a3-836a-90eaeaa9e88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:44.244713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cd625-56a5-40a3-836a-90eaeaa9e88b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:44.244989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cd625-56a5-40a3-836a-90eaeaa9e88b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:44.245282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cd625-56a5-40a3-836a-90eaeaa9e88b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:44.255178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cd625-56a5-40a3-836a-90eaeaa9e88b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:44.256643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cd625-56a5-40a3-836a-90eaeaa9e88b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0e3cd625-56a5-40a3-836a-90eaeaa9e88b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:44.268948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:44.270370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:44.271297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:44.271297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:44.271297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:44.271297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:44.271297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:44.271297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:44.271297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:44.271297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:44.271297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:44.271297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:44.276785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 431/862] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Sep 19 16:57:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:44.277227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cd625-56a5-40a3-836a-90eaeaa9e88b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:44.342836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:44.346350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cad73-05ff-42e6-8d87-fbac204051f2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:44.384964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92699b6b-1149-450f-81f1-05b160bd2bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:44.385881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92699b6b-1149-450f-81f1-05b160bd2bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:44.386165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92699b6b-1149-450f-81f1-05b160bd2bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:44.386548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92699b6b-1149-450f-81f1-05b160bd2bf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:44.387348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92699b6b-1149-450f-81f1-05b160bd2bf4 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=8834ef19c2604e8c828aa4dd32db61a7) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:44.387791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92699b6b-1149-450f-81f1-05b160bd2bf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:44.391410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92699b6b-1149-450f-81f1-05b160bd2bf4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:44.393425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cd625-56a5-40a3-836a-90eaeaa9e88b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:44.402224 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 432/863] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:44 2022] GET /identity/v3/role_assignments?user.id=8834ef19c2604e8c828aa4dd32db61a7&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=77285ef607e34662b6234656fe8043d0 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:44.441457 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4016f8d-caef-423c-a199-a7a0fd2c3d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:44.442567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4016f8d-caef-423c-a199-a7a0fd2c3d5d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:44.443005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4016f8d-caef-423c-a199-a7a0fd2c3d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:44.443451 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4016f8d-caef-423c-a199-a7a0fd2c3d5d None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:44.444382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4016f8d-caef-423c-a199-a7a0fd2c3d5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:44.444844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4016f8d-caef-423c-a199-a7a0fd2c3d5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:44.446518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4016f8d-caef-423c-a199-a7a0fd2c3d5d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:44.468107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 432/864] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Sep 19 16:57:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:44.478800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92699b6b-1149-450f-81f1-05b160bd2bf4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:44.595652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92699b6b-1149-450f-81f1-05b160bd2bf4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:44.636911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c601e9d-27e1-4449-9bd8-dc87a398117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:44.637532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601e9d-27e1-4449-9bd8-dc87a398117b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:44.637806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601e9d-27e1-4449-9bd8-dc87a398117b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:44.638074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c601e9d-27e1-4449-9bd8-dc87a398117b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:44.669544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:44.711278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c601e9d-27e1-4449-9bd8-dc87a398117b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:44.712787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c601e9d-27e1-4449-9bd8-dc87a398117b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:44.823816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 433/865] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:57:44.829359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4016f8d-caef-423c-a199-a7a0fd2c3d5d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:44.865832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7dffd-4067-4eda-bd4d-5ce6a2c354f1 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:44.866495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7dffd-4067-4eda-bd4d-5ce6a2c354f1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:44.866835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7dffd-4067-4eda-bd4d-5ce6a2c354f1 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:44.868551 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 434/866] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:44.873440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4cbe5-aa99-492b-9fa2-9d914d2c1ad8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:44.873732 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4cbe5-aa99-492b-9fa2-9d914d2c1ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:44.874011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4cbe5-aa99-492b-9fa2-9d914d2c1ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:44.881415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:44.893177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-03b4cbe5-aa99-492b-9fa2-9d914d2c1ad8 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:44.895074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-03b4cbe5-aa99-492b-9fa2-9d914d2c1ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:44.936131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4016f8d-caef-423c-a199-a7a0fd2c3d5d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:44.962518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:44.973063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 435/867] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:57:44.978102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4f15-bc50-4a83-8133-0cdd3813955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:44.978980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4f15-bc50-4a83-8133-0cdd3813955e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:44.979556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4f15-bc50-4a83-8133-0cdd3813955e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:44.980006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d4f15-bc50-4a83-8133-0cdd3813955e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:44.991170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d4f15-bc50-4a83-8133-0cdd3813955e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:44.992870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d4f15-bc50-4a83-8133-0cdd3813955e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ad4d4f15-bc50-4a83-8133-0cdd3813955e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:45.008110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:45.009079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:45.009984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:45.009984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:45.009984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:45.011711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 433/868] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:45.017538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4cbe5-aa99-492b-9fa2-9d914d2c1ad8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:45.123515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4cbe5-aa99-492b-9fa2-9d914d2c1ad8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:45.157476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750df5a-a786-4e70-a7bb-7d54f15b4368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:45.158096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750df5a-a786-4e70-a7bb-7d54f15b4368 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:45.158375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750df5a-a786-4e70-a7bb-7d54f15b4368 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:45.158650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750df5a-a786-4e70-a7bb-7d54f15b4368 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:45.159425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750df5a-a786-4e70-a7bb-7d54f15b4368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:45.159734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750df5a-a786-4e70-a7bb-7d54f15b4368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:45.161194 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750df5a-a786-4e70-a7bb-7d54f15b4368 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:45.173117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 436/869] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:45.178535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4f15-bc50-4a83-8133-0cdd3813955e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:45.278289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:45.284844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d4f15-bc50-4a83-8133-0cdd3813955e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:45.286178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750df5a-a786-4e70-a7bb-7d54f15b4368 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:45.320678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc395e28-cfc7-4fa4-9e74-22f7fb483621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:45.321356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc395e28-cfc7-4fa4-9e74-22f7fb483621 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:45.321633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc395e28-cfc7-4fa4-9e74-22f7fb483621 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:45.321903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc395e28-cfc7-4fa4-9e74-22f7fb483621 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:45.330462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc395e28-cfc7-4fa4-9e74-22f7fb483621 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:45.331923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc395e28-cfc7-4fa4-9e74-22f7fb483621 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-fc395e28-cfc7-4fa4-9e74-22f7fb483621 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:45.346042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:45.346946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:45.347829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:45.347829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:45.347829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:45.347829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:45.347829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:45.347829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:45.347829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:45.347829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:45.347829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 434/870] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:45.352618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:45.354322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc395e28-cfc7-4fa4-9e74-22f7fb483621 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:45.409069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750df5a-a786-4e70-a7bb-7d54f15b4368 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:45.445477 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194cade-00d0-44aa-97ec-70f473c32aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:45.446089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194cade-00d0-44aa-97ec-70f473c32aa4 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:45.446366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194cade-00d0-44aa-97ec-70f473c32aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:45.446635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194cade-00d0-44aa-97ec-70f473c32aa4 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:45.447393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194cade-00d0-44aa-97ec-70f473c32aa4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:45.448822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194cade-00d0-44aa-97ec-70f473c32aa4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:45.468039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 437/871] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:57:45 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:45.488026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc395e28-cfc7-4fa4-9e74-22f7fb483621 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:45.535782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f014a5-8164-4b6f-8ae6-5b427436d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:45.536379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f014a5-8164-4b6f-8ae6-5b427436d779 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:45.536661 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f014a5-8164-4b6f-8ae6-5b427436d779 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:45.536930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f014a5-8164-4b6f-8ae6-5b427436d779 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:45.537676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f014a5-8164-4b6f-8ae6-5b427436d779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:45.537979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f014a5-8164-4b6f-8ae6-5b427436d779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:45.539482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f014a5-8164-4b6f-8ae6-5b427436d779 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:45.554831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 435/872] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:45.560748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194cade-00d0-44aa-97ec-70f473c32aa4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:45.667606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194cade-00d0-44aa-97ec-70f473c32aa4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:45.681133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:45.704272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23117777-5fbf-4093-87ff-dd592967d9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:45.704884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23117777-5fbf-4093-87ff-dd592967d9cf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:45.705239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23117777-5fbf-4093-87ff-dd592967d9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:45.705508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23117777-5fbf-4093-87ff-dd592967d9cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:45.706280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23117777-5fbf-4093-87ff-dd592967d9cf None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=ee58334347c34e329ac250ae9e73aa93) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:45.706588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23117777-5fbf-4093-87ff-dd592967d9cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:45.708181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23117777-5fbf-4093-87ff-dd592967d9cf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:45.715376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 438/873] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:45 2022] GET /identity/v3/role_assignments?user.id=ee58334347c34e329ac250ae9e73aa93&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:46.369804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7ab66-a6ca-4c4f-ab7e-ca4f65d03397 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:46.370500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7ab66-a6ca-4c4f-ab7e-ca4f65d03397 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:46.370978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7ab66-a6ca-4c4f-ab7e-ca4f65d03397 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:46.372794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 436/874] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:46.378633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc19ed-2cd6-48c4-88e9-0487d4d4d687 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:46.379311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc19ed-2cd6-48c4-88e9-0487d4d4d687 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:46.379810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc19ed-2cd6-48c4-88e9-0487d4d4d687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:46.400141 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a8cc19ed-2cd6-48c4-88e9-0487d4d4d687 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:46.401697 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a8cc19ed-2cd6-48c4-88e9-0487d4d4d687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:46.472396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 439/875] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:46.668375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf5492-eca5-4bf4-b4fa-82794cf8a8d4 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:46.668881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf5492-eca5-4bf4-b4fa-82794cf8a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:46.668881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf5492-eca5-4bf4-b4fa-82794cf8a8d4 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:46.670551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 437/876] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:46.676639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac00e9-2dc9-4cc0-99c4-ea1fdd985c08 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:46.677181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac00e9-2dc9-4cc0-99c4-ea1fdd985c08 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:46.677257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac00e9-2dc9-4cc0-99c4-ea1fdd985c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:46.699542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-11ac00e9-2dc9-4cc0-99c4-ea1fdd985c08 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:46.700743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-11ac00e9-2dc9-4cc0-99c4-ea1fdd985c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:46.741168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf5492-eca5-4bf4-b4fa-82794cf8a8d4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:46.754126 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:46.786462 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 440/877] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:46.851126 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf5492-eca5-4bf4-b4fa-82794cf8a8d4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:46.886289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ef176-9f3a-4e0d-a637-13c884a45d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:46.887222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ef176-9f3a-4e0d-a637-13c884a45d47 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:46.887718 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ef176-9f3a-4e0d-a637-13c884a45d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:46.888184 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ef176-9f3a-4e0d-a637-13c884a45d47 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:46.889060 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ef176-9f3a-4e0d-a637-13c884a45d47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:46.890687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ef176-9f3a-4e0d-a637-13c884a45d47 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:46.917217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 438/878] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:57:46 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:57:47.063123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac00e9-2dc9-4cc0-99c4-ea1fdd985c08 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:47.115328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:47.208850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac00e9-2dc9-4cc0-99c4-ea1fdd985c08 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:47.249979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c7305-890b-4d21-b8be-03e956e45864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:47.250623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c7305-890b-4d21-b8be-03e956e45864 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:47.250901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c7305-890b-4d21-b8be-03e956e45864 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:47.251167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c7305-890b-4d21-b8be-03e956e45864 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:47.251740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c7305-890b-4d21-b8be-03e956e45864 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:47.253142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c7305-890b-4d21-b8be-03e956e45864 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-fc5c7305-890b-4d21-b8be-03e956e45864 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:47.261976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:47.262933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:47.263912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 441/879] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:57:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:47.269701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ef176-9f3a-4e0d-a637-13c884a45d47 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:47.341917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:47.375041 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ef176-9f3a-4e0d-a637-13c884a45d47 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:47.409523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee2ff5-4a6b-4d4a-a68e-ba5f6666bb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:47.410554 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2ff5-4a6b-4d4a-a68e-ba5f6666bb5e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:47.411053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2ff5-4a6b-4d4a-a68e-ba5f6666bb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:47.411536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2ff5-4a6b-4d4a-a68e-ba5f6666bb5e None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:47.412365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee2ff5-4a6b-4d4a-a68e-ba5f6666bb5e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:47.412862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee2ff5-4a6b-4d4a-a68e-ba5f6666bb5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:47.414455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee2ff5-4a6b-4d4a-a68e-ba5f6666bb5e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:47.419862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 439/880] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Sep 19 16:57:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:47.425439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c7305-890b-4d21-b8be-03e956e45864 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:47.532977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:47.537251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c7305-890b-4d21-b8be-03e956e45864 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:47.576366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148fbdf-5561-42f4-8279-1204c7d84024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:47.577022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fbdf-5561-42f4-8279-1204c7d84024 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:47.577334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fbdf-5561-42f4-8279-1204c7d84024 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:47.577608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148fbdf-5561-42f4-8279-1204c7d84024 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:47.578277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148fbdf-5561-42f4-8279-1204c7d84024 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:47.579052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148fbdf-5561-42f4-8279-1204c7d84024 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:47.581016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148fbdf-5561-42f4-8279-1204c7d84024 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:47.586859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 442/881] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Sep 19 16:57:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:47.700974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8a82e-9d22-427c-8c60-7b2dd8ad801a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:47.701525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8a82e-9d22-427c-8c60-7b2dd8ad801a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:47.701525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8a82e-9d22-427c-8c60-7b2dd8ad801a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:47.703086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 440/882] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:47.712341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acafb42-f1f9-4192-ac60-156d1355d44b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:47.712341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acafb42-f1f9-4192-ac60-156d1355d44b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:47.712341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acafb42-f1f9-4192-ac60-156d1355d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:47.730539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4acafb42-f1f9-4192-ac60-156d1355d44b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:47.732070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4acafb42-f1f9-4192-ac60-156d1355d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:47.803956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 443/883] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:48.034920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109f7b6-0a30-40a0-af52-4cea1237367b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:48.035198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109f7b6-0a30-40a0-af52-4cea1237367b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:48.035492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109f7b6-0a30-40a0-af52-4cea1237367b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:48.037103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 441/884] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:48.042290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456200a-3526-4fea-b6bb-380854429804 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:48.042575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456200a-3526-4fea-b6bb-380854429804 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:48.042846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456200a-3526-4fea-b6bb-380854429804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:48.060880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3456200a-3526-4fea-b6bb-380854429804 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:48.062097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3456200a-3526-4fea-b6bb-380854429804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:48.079867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109f7b6-0a30-40a0-af52-4cea1237367b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:48.135848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 444/885] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:48.198600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109f7b6-0a30-40a0-af52-4cea1237367b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:48.233124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b297991-57bf-4f09-8a7b-2450542276e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:48.234155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b297991-57bf-4f09-8a7b-2450542276e9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:48.234647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b297991-57bf-4f09-8a7b-2450542276e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:48.235107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b297991-57bf-4f09-8a7b-2450542276e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:48.235895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b297991-57bf-4f09-8a7b-2450542276e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:48.237666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b297991-57bf-4f09-8a7b-2450542276e9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:48.239906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3b297991-57bf-4f09-8a7b-2450542276e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:48.247936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:48.248927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:48.249794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 442/886] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:57:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:48.255531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456200a-3526-4fea-b6bb-380854429804 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:48.284773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:48.368891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456200a-3526-4fea-b6bb-380854429804 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:48.404609 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabc364-812e-4f34-92dd-bfb2796937e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:48.405247 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabc364-812e-4f34-92dd-bfb2796937e9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:48.405523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabc364-812e-4f34-92dd-bfb2796937e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:48.405792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabc364-812e-4f34-92dd-bfb2796937e9 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:48.406423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabc364-812e-4f34-92dd-bfb2796937e9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:48.406720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabc364-812e-4f34-92dd-bfb2796937e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:48.408091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabc364-812e-4f34-92dd-bfb2796937e9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:48.413279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 445/887] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:57:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:48.418758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b297991-57bf-4f09-8a7b-2450542276e9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:48.426988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabc364-812e-4f34-92dd-bfb2796937e9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:48.522729 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b297991-57bf-4f09-8a7b-2450542276e9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:48.529584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:48.551153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabc364-812e-4f34-92dd-bfb2796937e9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:48.560361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610153-621c-4571-bbd9-1a86be833e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:48.560978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610153-621c-4571-bbd9-1a86be833e54 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:48.561317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610153-621c-4571-bbd9-1a86be833e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:48.561588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02610153-621c-4571-bbd9-1a86be833e54 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:48.562233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02610153-621c-4571-bbd9-1a86be833e54 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:48.562533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02610153-621c-4571-bbd9-1a86be833e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:48.563984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02610153-621c-4571-bbd9-1a86be833e54 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:48.569638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 443/888] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:57:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:48.575813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610153-621c-4571-bbd9-1a86be833e54 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:48.590167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ffd1-9f3d-47e3-b317-d9102bc6af8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:48.590834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ffd1-9f3d-47e3-b317-d9102bc6af8b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:48.591338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ffd1-9f3d-47e3-b317-d9102bc6af8b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:48.591606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ffd1-9f3d-47e3-b317-d9102bc6af8b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:48.603994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485ffd1-9f3d-47e3-b317-d9102bc6af8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f485ffd1-9f3d-47e3-b317-d9102bc6af8b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:48.610193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:48.611409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:48.612324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 446/889] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Sep 19 16:57:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:48.618043 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ffd1-9f3d-47e3-b317-d9102bc6af8b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:48.649906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:48.691204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02610153-621c-4571-bbd9-1a86be833e54 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:48.726619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15429e4-da75-48d8-b706-badf782efbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:48.727287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15429e4-da75-48d8-b706-badf782efbae None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:48.727556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15429e4-da75-48d8-b706-badf782efbae None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:48.727832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15429e4-da75-48d8-b706-badf782efbae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:48.728537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15429e4-da75-48d8-b706-badf782efbae None admin] RBAC: Adding query filter params (interface=public, service_id=aa2756c1179f45998c917a3a792d3281, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:48.728840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15429e4-da75-48d8-b706-badf782efbae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:48.730251 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15429e4-da75-48d8-b706-badf782efbae None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:48.739698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ffd1-9f3d-47e3-b317-d9102bc6af8b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:48.741380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 444/890] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Sep 19 16:57:48 2022] GET /identity/v3/endpoints?service_id=aa2756c1179f45998c917a3a792d3281&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:48.743876 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15429e4-da75-48d8-b706-badf782efbae None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:48.779858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7d60b-76aa-4fe4-beb6-3a411165dff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:48.781065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7d60b-76aa-4fe4-beb6-3a411165dff9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:48.781553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7d60b-76aa-4fe4-beb6-3a411165dff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:48.782028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7d60b-76aa-4fe4-beb6-3a411165dff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:48.782897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7d60b-76aa-4fe4-beb6-3a411165dff9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:48.783405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7d60b-76aa-4fe4-beb6-3a411165dff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:48.784987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7d60b-76aa-4fe4-beb6-3a411165dff9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:48.799241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 447/891] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Sep 19 16:57:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:48.800328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7d60b-76aa-4fe4-beb6-3a411165dff9 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:48.815479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:48.865404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15429e4-da75-48d8-b706-badf782efbae None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:48.891318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:48.901717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026c4bf-ebc2-4ede-8a0c-fb0288079400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:48.902258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026c4bf-ebc2-4ede-8a0c-fb0288079400 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:48.902535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026c4bf-ebc2-4ede-8a0c-fb0288079400 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:48.902805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026c4bf-ebc2-4ede-8a0c-fb0288079400 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:48.903528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026c4bf-ebc2-4ede-8a0c-fb0288079400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:48.904791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026c4bf-ebc2-4ede-8a0c-fb0288079400 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:48.916634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 445/892] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Sep 19 16:57:48 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:57:48.933434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7d60b-76aa-4fe4-beb6-3a411165dff9 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:48.973177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab9870-cad7-449e-8134-00effecaf936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:48.974255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab9870-cad7-449e-8134-00effecaf936 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:48.974753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab9870-cad7-449e-8134-00effecaf936 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:48.975634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab9870-cad7-449e-8134-00effecaf936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:48.988792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab9870-cad7-449e-8134-00effecaf936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:48.992005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab9870-cad7-449e-8134-00effecaf936 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-24ab9870-cad7-449e-8134-00effecaf936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:49.009225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:49.010276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:49.011180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:49.011180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:49.011180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:49.013591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 448/893] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:49.020047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026c4bf-ebc2-4ede-8a0c-fb0288079400 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:49.132971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026c4bf-ebc2-4ede-8a0c-fb0288079400 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:49.160275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b2715-80b2-4196-9557-b5d45aea604c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:49.160518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b2715-80b2-4196-9557-b5d45aea604c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:49.160801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b2715-80b2-4196-9557-b5d45aea604c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:49.163014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 449/894] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:49.169105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8e7a-b24d-48c5-888c-f500d09ec978 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:49.169490 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8e7a-b24d-48c5-888c-f500d09ec978 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:49.169767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8e7a-b24d-48c5-888c-f500d09ec978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:49.175800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5412940-dc9d-436a-be6f-2d7476c65b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:49.176731 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5412940-dc9d-436a-be6f-2d7476c65b81 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:49.177257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5412940-dc9d-436a-be6f-2d7476c65b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:49.177729 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5412940-dc9d-436a-be6f-2d7476c65b81 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:49.178604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5412940-dc9d-436a-be6f-2d7476c65b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:49.179100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5412940-dc9d-436a-be6f-2d7476c65b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:49.180669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5412940-dc9d-436a-be6f-2d7476c65b81 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:49.189277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f54a8e7a-b24d-48c5-888c-f500d09ec978 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:49.190834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f54a8e7a-b24d-48c5-888c-f500d09ec978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:49.194394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 446/895] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:49.202694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5412940-dc9d-436a-be6f-2d7476c65b81 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:49.251278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:49.254943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:49.270235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 450/896] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:49.314105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5412940-dc9d-436a-be6f-2d7476c65b81 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:49.349473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c6849-1e7b-488d-86ee-72337fb6f727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:49.350107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c6849-1e7b-488d-86ee-72337fb6f727 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:49.350380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c6849-1e7b-488d-86ee-72337fb6f727 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:49.350646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c6849-1e7b-488d-86ee-72337fb6f727 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:49.357922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c6849-1e7b-488d-86ee-72337fb6f727 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:49.359469 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c6849-1e7b-488d-86ee-72337fb6f727 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c54c6849-1e7b-488d-86ee-72337fb6f727 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:49.371103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:49.372067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:49.373266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 447/897] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Sep 19 16:57:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:49.380128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8e7a-b24d-48c5-888c-f500d09ec978 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:49.482888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8e7a-b24d-48c5-888c-f500d09ec978 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:49.520118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd87646-7d9c-403d-bdd8-b82e4479b1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:49.520739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd87646-7d9c-403d-bdd8-b82e4479b1cd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:49.521024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd87646-7d9c-403d-bdd8-b82e4479b1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:49.521327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd87646-7d9c-403d-bdd8-b82e4479b1cd None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:49.522065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd87646-7d9c-403d-bdd8-b82e4479b1cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:49.522370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd87646-7d9c-403d-bdd8-b82e4479b1cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:49.523814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd87646-7d9c-403d-bdd8-b82e4479b1cd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:49.542747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 451/898] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Sep 19 16:57:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:49.548555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c6849-1e7b-488d-86ee-72337fb6f727 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:49.553932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd87646-7d9c-403d-bdd8-b82e4479b1cd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:49.603627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:49.662046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd87646-7d9c-403d-bdd8-b82e4479b1cd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:49.667279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c6849-1e7b-488d-86ee-72337fb6f727 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:49.679353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:49.701649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76224130-40aa-47ac-8123-077245e9c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:49.702926 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76224130-40aa-47ac-8123-077245e9c3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:49.703858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76224130-40aa-47ac-8123-077245e9c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:49.704657 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76224130-40aa-47ac-8123-077245e9c3c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:49.705661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76224130-40aa-47ac-8123-077245e9c3c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:49.707552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76224130-40aa-47ac-8123-077245e9c3c3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:49.708545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c2847-0b88-43c2-b1f3-ee449b6205d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:49.709289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c2847-0b88-43c2-b1f3-ee449b6205d1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:49.709568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c2847-0b88-43c2-b1f3-ee449b6205d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:49.709833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c2847-0b88-43c2-b1f3-ee449b6205d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-76224130-40aa-47ac-8123-077245e9c3c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:49.718820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:49.719883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:57:49.720778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:49.723889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 452/899] 10.222.0.76 () {56 vars in 1132 bytes} [Mon Sep 19 16:57:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:49.732385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76224130-40aa-47ac-8123-077245e9c3c3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:49.788986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c2847-0b88-43c2-b1f3-ee449b6205d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:49.790376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c2847-0b88-43c2-b1f3-ee449b6205d1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:49.847073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76224130-40aa-47ac-8123-077245e9c3c3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:49.860924 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:49.885687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b289-69f6-4a57-9dbc-7cd8e38e2159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:49.886318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b289-69f6-4a57-9dbc-7cd8e38e2159 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:49.886591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b289-69f6-4a57-9dbc-7cd8e38e2159 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:49.886924 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b289-69f6-4a57-9dbc-7cd8e38e2159 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:49.887569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b289-69f6-4a57-9dbc-7cd8e38e2159 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:49.887881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b289-69f6-4a57-9dbc-7cd8e38e2159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:49.889285 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b289-69f6-4a57-9dbc-7cd8e38e2159 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:49.899551 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 453/900] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:57:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:49.900809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd921-b758-48df-ae13-699a1cd1a361 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:49.901115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd921-b758-48df-ae13-699a1cd1a361 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:49.901390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd921-b758-48df-ae13-699a1cd1a361 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:49.906672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 448/901] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:49 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:57:49.906802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 454/902] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:49.907990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c2847-0b88-43c2-b1f3-ee449b6205d1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:49.908168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b1ab-ff0b-407d-9fc9-76c5695b256e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:49.908476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b1ab-ff0b-407d-9fc9-76c5695b256e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:49.908931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7b1ab-ff0b-407d-9fc9-76c5695b256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:49.921433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:49.927846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e3d7b1ab-ff0b-407d-9fc9-76c5695b256e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:49.929081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e3d7b1ab-ff0b-407d-9fc9-76c5695b256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:49.998096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 455/903] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:49.999169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7b1ab-ff0b-407d-9fc9-76c5695b256e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:50.025068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c2847-0b88-43c2-b1f3-ee449b6205d1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:50.067714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59a270-17fa-4972-a0a1-eeada77f8862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:50.068456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59a270-17fa-4972-a0a1-eeada77f8862 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:50.069349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59a270-17fa-4972-a0a1-eeada77f8862 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:50.069716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59a270-17fa-4972-a0a1-eeada77f8862 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:50.070621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59a270-17fa-4972-a0a1-eeada77f8862 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:50.071129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59a270-17fa-4972-a0a1-eeada77f8862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:50.073253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59a270-17fa-4972-a0a1-eeada77f8862 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:50.079571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 449/904] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:57:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:50.086234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59a270-17fa-4972-a0a1-eeada77f8862 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:50.138391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7b1ab-ff0b-407d-9fc9-76c5695b256e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:50.147492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:50.183490 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a730c8-f17d-4a1b-a017-ebdb6fbde9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:50.184127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a730c8-f17d-4a1b-a017-ebdb6fbde9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:50.184402 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a730c8-f17d-4a1b-a017-ebdb6fbde9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:50.184673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a730c8-f17d-4a1b-a017-ebdb6fbde9b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:50.191722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:50.196851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a730c8-f17d-4a1b-a017-ebdb6fbde9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:50.198352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a730c8-f17d-4a1b-a017-ebdb6fbde9b6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a1a730c8-f17d-4a1b-a017-ebdb6fbde9b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:50.214590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:50.215558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:50.216449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:50.216449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:50.216449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:50.219150 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 456/905] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:50.224356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a730c8-f17d-4a1b-a017-ebdb6fbde9b6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:50.228933 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59a270-17fa-4972-a0a1-eeada77f8862 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:50.264449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddb8c9-c846-47e0-8c83-445df9bf73ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:50.265289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddb8c9-c846-47e0-8c83-445df9bf73ef None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:50.265666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddb8c9-c846-47e0-8c83-445df9bf73ef None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:50.265992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddb8c9-c846-47e0-8c83-445df9bf73ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:50.266862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddb8c9-c846-47e0-8c83-445df9bf73ef None admin] RBAC: Adding query filter params (interface=public, service_id=68980686fa4f4eebac9fd26b2388d8f0, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:50.267235 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddb8c9-c846-47e0-8c83-445df9bf73ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:50.268668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddb8c9-c846-47e0-8c83-445df9bf73ef None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:50.279314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 450/906] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Sep 19 16:57:50 2022] GET /identity/v3/endpoints?service_id=68980686fa4f4eebac9fd26b2388d8f0&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:50.279314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddb8c9-c846-47e0-8c83-445df9bf73ef None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:50.342349 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a730c8-f17d-4a1b-a017-ebdb6fbde9b6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:50.376590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94a93c-cb44-446a-96d5-7e0b37795ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:50.376767 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddb8c9-c846-47e0-8c83-445df9bf73ef None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:50.377239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a93c-cb44-446a-96d5-7e0b37795ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:50.377526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a93c-cb44-446a-96d5-7e0b37795ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:50.377810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a93c-cb44-446a-96d5-7e0b37795ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:50.378453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94a93c-cb44-446a-96d5-7e0b37795ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:50.378763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94a93c-cb44-446a-96d5-7e0b37795ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:50.380196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94a93c-cb44-446a-96d5-7e0b37795ed8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:50.397352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 457/907] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:50.397352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94a93c-cb44-446a-96d5-7e0b37795ed8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:50.415185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:50.417764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d1c16-63c9-456c-9fcf-2d71272c513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:50.418574 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1c16-63c9-456c-9fcf-2d71272c513d None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:50.419339 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1c16-63c9-456c-9fcf-2d71272c513d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:50.419616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d1c16-63c9-456c-9fcf-2d71272c513d None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:50.420275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d1c16-63c9-456c-9fcf-2d71272c513d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:50.421683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d1c16-63c9-456c-9fcf-2d71272c513d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:50.433594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:50.449445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 451/908] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:57:50 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:57:50.450498 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d1c16-63c9-456c-9fcf-2d71272c513d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:50.502155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94a93c-cb44-446a-96d5-7e0b37795ed8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:50.547676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128944e-6f83-4bb5-9ed8-b8747d98db7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:50.548480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128944e-6f83-4bb5-9ed8-b8747d98db7d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:50.548825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128944e-6f83-4bb5-9ed8-b8747d98db7d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:50.549190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128944e-6f83-4bb5-9ed8-b8747d98db7d None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:50.549921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128944e-6f83-4bb5-9ed8-b8747d98db7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:50.551440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128944e-6f83-4bb5-9ed8-b8747d98db7d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:50.565088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 458/909] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Sep 19 16:57:50 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:57:50.595570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d1c16-63c9-456c-9fcf-2d71272c513d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:50.637724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3bd3a-3679-4383-9be3-785afc88bb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:50.638399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3bd3a-3679-4383-9be3-785afc88bb0f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:50.638687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3bd3a-3679-4383-9be3-785afc88bb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:50.639023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3bd3a-3679-4383-9be3-785afc88bb0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:50.647780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3bd3a-3679-4383-9be3-785afc88bb0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:50.649414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3bd3a-3679-4383-9be3-785afc88bb0f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-29c3bd3a-3679-4383-9be3-785afc88bb0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:50.663076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:50.664045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:50.665205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:50.665205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:50.665205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:50.665205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:50.665205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:50.665205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:50.665205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:50.665205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:50.665205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 452/910] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:50.671755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128944e-6f83-4bb5-9ed8-b8747d98db7d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:50.760222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:50.783822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128944e-6f83-4bb5-9ed8-b8747d98db7d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:50.819459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6405d96-4e63-4310-90c6-225e7519a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:50.820088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6405d96-4e63-4310-90c6-225e7519a579 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:50.820370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6405d96-4e63-4310-90c6-225e7519a579 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:50.820644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6405d96-4e63-4310-90c6-225e7519a579 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:50.821385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6405d96-4e63-4310-90c6-225e7519a579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:50.821697 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6405d96-4e63-4310-90c6-225e7519a579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:50.823222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6405d96-4e63-4310-90c6-225e7519a579 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:50.836874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 459/911] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:50.842808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3bd3a-3679-4383-9be3-785afc88bb0f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:50.909492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:50.948716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3bd3a-3679-4383-9be3-785afc88bb0f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:50.983359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3af93f-e700-4fc6-9b75-18639951ae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:50.983983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af93f-e700-4fc6-9b75-18639951ae07 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:50.984263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af93f-e700-4fc6-9b75-18639951ae07 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:50.984535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3af93f-e700-4fc6-9b75-18639951ae07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:50.985307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3af93f-e700-4fc6-9b75-18639951ae07 None admin] RBAC: Adding query filter params (role.id=df4a78a83b4846d5b311f4b9f038b434, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=ee58334347c34e329ac250ae9e73aa93) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:50.985615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3af93f-e700-4fc6-9b75-18639951ae07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:50.987061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3af93f-e700-4fc6-9b75-18639951ae07 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:50.997185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 453/912] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:57:50 2022] GET /identity/v3/role_assignments?user.id=ee58334347c34e329ac250ae9e73aa93&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=df4a78a83b4846d5b311f4b9f038b434 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:51.210630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac937a-e2d8-472d-97b0-e27395bb3aad None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:51.211151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac937a-e2d8-472d-97b0-e27395bb3aad None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:51.211151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac937a-e2d8-472d-97b0-e27395bb3aad None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:51.212447 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 460/913] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:51.217896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cd912-63c4-4baa-8c06-3450afbfa829 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:51.218254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cd912-63c4-4baa-8c06-3450afbfa829 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:51.218593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cd912-63c4-4baa-8c06-3450afbfa829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:51.238132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b59cd912-63c4-4baa-8c06-3450afbfa829 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:51.239358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b59cd912-63c4-4baa-8c06-3450afbfa829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:51.306712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 454/914] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:51.572230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac937a-e2d8-472d-97b0-e27395bb3aad None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:51.671819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac937a-e2d8-472d-97b0-e27395bb3aad None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:51.710065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcfb02-a3bf-4e11-b4df-51f7812ce7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:51.710726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcfb02-a3bf-4e11-b4df-51f7812ce7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:51.711009 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcfb02-a3bf-4e11-b4df-51f7812ce7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:51.711282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcfb02-a3bf-4e11-b4df-51f7812ce7c3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:51.711871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcfb02-a3bf-4e11-b4df-51f7812ce7c3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:51.713294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcfb02-a3bf-4e11-b4df-51f7812ce7c3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-2dbcfb02-a3bf-4e11-b4df-51f7812ce7c3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:51.722590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:51.723616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:51.724467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 461/915] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:57:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:51.729833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cd912-63c4-4baa-8c06-3450afbfa829 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:51.782870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:51.831278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cd912-63c4-4baa-8c06-3450afbfa829 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:51.865840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ca7bc-22b9-495a-898e-fdfbcaec6904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:51.866494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ca7bc-22b9-495a-898e-fdfbcaec6904 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:51.866718 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ca7bc-22b9-495a-898e-fdfbcaec6904 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:51.866994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ca7bc-22b9-495a-898e-fdfbcaec6904 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:51.867620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ca7bc-22b9-495a-898e-fdfbcaec6904 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:51.867920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ca7bc-22b9-495a-898e-fdfbcaec6904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:51.869328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ca7bc-22b9-495a-898e-fdfbcaec6904 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:51.874645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 455/916] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:57:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:51.881649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcfb02-a3bf-4e11-b4df-51f7812ce7c3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:51.884807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:51.989312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcfb02-a3bf-4e11-b4df-51f7812ce7c3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:52.023294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4416a6f-8bce-48aa-a47a-c289c6466bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:52.023916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4416a6f-8bce-48aa-a47a-c289c6466bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:52.024197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4416a6f-8bce-48aa-a47a-c289c6466bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:52.024473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4416a6f-8bce-48aa-a47a-c289c6466bc9 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:52.025136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4416a6f-8bce-48aa-a47a-c289c6466bc9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:52.025441 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4416a6f-8bce-48aa-a47a-c289c6466bc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:52.026818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4416a6f-8bce-48aa-a47a-c289c6466bc9 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:52.031930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 462/917] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Sep 19 16:57:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:52.037554 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ca7bc-22b9-495a-898e-fdfbcaec6904 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:52.141295 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ca7bc-22b9-495a-898e-fdfbcaec6904 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:52.170812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:52.173245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e861e-632e-4dfb-ab64-bd98bf6fb68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:52.173865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e861e-632e-4dfb-ab64-bd98bf6fb68d None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:52.174335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e861e-632e-4dfb-ab64-bd98bf6fb68d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:52.174430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e861e-632e-4dfb-ab64-bd98bf6fb68d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:52.175061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e861e-632e-4dfb-ab64-bd98bf6fb68d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:52.176578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e861e-632e-4dfb-ab64-bd98bf6fb68d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:52.205141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 456/918] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 16:57:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:52.767276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4285e08-c506-4261-968b-6bb04ec5e76a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:52.767813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4285e08-c506-4261-968b-6bb04ec5e76a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:52.767813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4285e08-c506-4261-968b-6bb04ec5e76a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:52.769818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 463/919] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:52.775884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22da5-4d6a-456d-982a-b5ebbadcabe4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:52.776170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22da5-4d6a-456d-982a-b5ebbadcabe4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:52.776446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22da5-4d6a-456d-982a-b5ebbadcabe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:52.794747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-02a22da5-4d6a-456d-982a-b5ebbadcabe4 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:52.795931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-02a22da5-4d6a-456d-982a-b5ebbadcabe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:52.858321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7eaf6-e921-4c9e-a57b-8e7ec0672ad5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:52.858975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7eaf6-e921-4c9e-a57b-8e7ec0672ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:52.859447 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7eaf6-e921-4c9e-a57b-8e7ec0672ad5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:52.861338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 464/920] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:52.865945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1effb5d-790a-4deb-bad5-707dda467ccf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:52.866227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1effb5d-790a-4deb-bad5-707dda467ccf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:52.866500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1effb5d-790a-4deb-bad5-707dda467ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:52.876774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 457/921] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:52.889115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b1effb5d-790a-4deb-bad5-707dda467ccf None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:52.890316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b1effb5d-790a-4deb-bad5-707dda467ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:52.952732 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:52.962351 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 465/922] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:57:53.153534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22da5-4d6a-456d-982a-b5ebbadcabe4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:53.218400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bba2bc-41c8-42de-8591-beaf52a0ae47 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:53.219157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bba2bc-41c8-42de-8591-beaf52a0ae47 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:53.219659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bba2bc-41c8-42de-8591-beaf52a0ae47 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:53.221613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 466/923] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:53.226251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bba2bc-41c8-42de-8591-beaf52a0ae47 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:53.251360 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:53.255879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22da5-4d6a-456d-982a-b5ebbadcabe4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:53.291668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919e5e1-2a17-405b-a200-1ab217ab685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:53.292506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919e5e1-2a17-405b-a200-1ab217ab685a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:53.292617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919e5e1-2a17-405b-a200-1ab217ab685a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:53.292817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919e5e1-2a17-405b-a200-1ab217ab685a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:53.293411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919e5e1-2a17-405b-a200-1ab217ab685a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:53.294788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919e5e1-2a17-405b-a200-1ab217ab685a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6919e5e1-2a17-405b-a200-1ab217ab685a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:53.304739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:53.305885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:53.307069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 458/924] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:57:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:53.307949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985dbcc-b228-461b-820a-40c4f3f25c9a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:53.307949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985dbcc-b228-461b-820a-40c4f3f25c9a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:53.307949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985dbcc-b228-461b-820a-40c4f3f25c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:53.324260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f985dbcc-b228-461b-820a-40c4f3f25c9a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:53.325479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f985dbcc-b228-461b-820a-40c4f3f25c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:53.346468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bba2bc-41c8-42de-8591-beaf52a0ae47 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:53.384518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614068e-5621-4fa6-a010-350ebd839b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:53.385185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614068e-5621-4fa6-a010-350ebd839b57 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:53.385489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614068e-5621-4fa6-a010-350ebd839b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:53.385762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614068e-5621-4fa6-a010-350ebd839b57 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:53.386336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614068e-5621-4fa6-a010-350ebd839b57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:53.387757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614068e-5621-4fa6-a010-350ebd839b57 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:53.396644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 459/925] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-a614068e-5621-4fa6-a010-350ebd839b57 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:53.396777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:53.397991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 16:57:53.399223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:53.401920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985dbcc-b228-461b-820a-40c4f3f25c9a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:53.402962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 467/926] 10.222.0.76 () {56 vars in 1132 bytes} [Mon Sep 19 16:57:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:53.403637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614068e-5621-4fa6-a010-350ebd839b57 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:53.478672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:53.502539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:53.513662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985dbcc-b228-461b-820a-40c4f3f25c9a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:53.531868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614068e-5621-4fa6-a010-350ebd839b57 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:53.551037 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce96d7-04db-4ee7-ab35-f92559966ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:53.551980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce96d7-04db-4ee7-ab35-f92559966ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:53.552444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce96d7-04db-4ee7-ab35-f92559966ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:53.552966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce96d7-04db-4ee7-ab35-f92559966ca4 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:53.553950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce96d7-04db-4ee7-ab35-f92559966ca4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:53.554419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce96d7-04db-4ee7-ab35-f92559966ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:53.556006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce96d7-04db-4ee7-ab35-f92559966ca4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:53.561185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 460/927] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Sep 19 16:57:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:53.567078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce96d7-04db-4ee7-ab35-f92559966ca4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:53.576326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101914a2-ed24-4e06-9b3c-e6b1b7d44269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:53.576945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101914a2-ed24-4e06-9b3c-e6b1b7d44269 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:53.577261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101914a2-ed24-4e06-9b3c-e6b1b7d44269 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:53.577532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101914a2-ed24-4e06-9b3c-e6b1b7d44269 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:53.578170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101914a2-ed24-4e06-9b3c-e6b1b7d44269 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:53.578471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101914a2-ed24-4e06-9b3c-e6b1b7d44269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:53.580372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101914a2-ed24-4e06-9b3c-e6b1b7d44269 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:53.586635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 468/928] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:57:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:53.591878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101914a2-ed24-4e06-9b3c-e6b1b7d44269 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:53.700314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce96d7-04db-4ee7-ab35-f92559966ca4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:53.701633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101914a2-ed24-4e06-9b3c-e6b1b7d44269 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:53.725535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:53.735201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4941866-d98b-4773-980d-68a351e2b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:53.735809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941866-d98b-4773-980d-68a351e2b99e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:53.736089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941866-d98b-4773-980d-68a351e2b99e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:53.736350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941866-d98b-4773-980d-68a351e2b99e None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:53.736977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4941866-d98b-4773-980d-68a351e2b99e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:53.737311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4941866-d98b-4773-980d-68a351e2b99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:53.738698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4941866-d98b-4773-980d-68a351e2b99e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:53.739194 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c161ae-110e-43d8-938f-03ca174ac05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:53.739799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c161ae-110e-43d8-938f-03ca174ac05d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:53.740079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c161ae-110e-43d8-938f-03ca174ac05d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:53.740352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c161ae-110e-43d8-938f-03ca174ac05d None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:53.740981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c161ae-110e-43d8-938f-03ca174ac05d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:53.741350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c161ae-110e-43d8-938f-03ca174ac05d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:53.742702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c161ae-110e-43d8-938f-03ca174ac05d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:53.743816 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 461/929] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Sep 19 16:57:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:53.744368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4941866-d98b-4773-980d-68a351e2b99e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:53.752646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 469/930] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:57:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:53.753310 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c161ae-110e-43d8-938f-03ca174ac05d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:53.770780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:53.854688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4941866-d98b-4773-980d-68a351e2b99e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:53.857545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c161ae-110e-43d8-938f-03ca174ac05d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:53.890580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1166e-d5a3-4807-a6e5-07164d6163da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:53.891210 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1166e-d5a3-4807-a6e5-07164d6163da None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:53.891486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1166e-d5a3-4807-a6e5-07164d6163da None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:53.891752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1166e-d5a3-4807-a6e5-07164d6163da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:53.893823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f2672-92ae-4bec-b3ec-90a069a1564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:53.895154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f2672-92ae-4bec-b3ec-90a069a1564b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:53.895438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f2672-92ae-4bec-b3ec-90a069a1564b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:53.895714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f2672-92ae-4bec-b3ec-90a069a1564b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:53.896420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f2672-92ae-4bec-b3ec-90a069a1564b None admin] RBAC: Adding query filter params (interface=public, service_id=98de4da1ee8645d9a8479d914db7c616, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:53.896894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f2672-92ae-4bec-b3ec-90a069a1564b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:53.898298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f2672-92ae-4bec-b3ec-90a069a1564b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:53.902671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1166e-d5a3-4807-a6e5-07164d6163da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:53.908399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 470/931] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Sep 19 16:57:53 2022] GET /identity/v3/endpoints?service_id=98de4da1ee8645d9a8479d914db7c616&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:53.908399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f2672-92ae-4bec-b3ec-90a069a1564b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-abc1166e-d5a3-4807-a6e5-07164d6163da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:53.908593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:53.910845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 462/932] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Sep 19 16:57:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:53.911892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1166e-d5a3-4807-a6e5-07164d6163da None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:53.968628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:53.999343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:54.020888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1166e-d5a3-4807-a6e5-07164d6163da None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:54.021377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f2672-92ae-4bec-b3ec-90a069a1564b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:54.055763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7dd9b-777f-4c88-a335-37cac849d926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:54.056009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475fe0-4ada-4845-ae3e-1a2ccaddc302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:54.056386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7dd9b-777f-4c88-a335-37cac849d926 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:54.056591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475fe0-4ada-4845-ae3e-1a2ccaddc302 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:54.056688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7dd9b-777f-4c88-a335-37cac849d926 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:54.056867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475fe0-4ada-4845-ae3e-1a2ccaddc302 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:54.056962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7dd9b-777f-4c88-a335-37cac849d926 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:54.057166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a475fe0-4ada-4845-ae3e-1a2ccaddc302 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:54.057651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7dd9b-777f-4c88-a335-37cac849d926 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:54.057759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a475fe0-4ada-4845-ae3e-1a2ccaddc302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:54.059039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7dd9b-777f-4c88-a335-37cac849d926 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:54.059137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a475fe0-4ada-4845-ae3e-1a2ccaddc302 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:54.065080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 463/933] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Sep 19 16:57:53 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:57:54.065730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475fe0-4ada-4845-ae3e-1a2ccaddc302 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:54.097253 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 471/934] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 16:57:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:54.202958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a475fe0-4ada-4845-ae3e-1a2ccaddc302 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:54.253276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51246783-3b6a-497e-8c75-5c5dcfac0cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:54.253907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51246783-3b6a-497e-8c75-5c5dcfac0cab None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:54.254252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51246783-3b6a-497e-8c75-5c5dcfac0cab None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:54.254527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51246783-3b6a-497e-8c75-5c5dcfac0cab None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:54.255208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51246783-3b6a-497e-8c75-5c5dcfac0cab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:54.255564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51246783-3b6a-497e-8c75-5c5dcfac0cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:54.256975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51246783-3b6a-497e-8c75-5c5dcfac0cab None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:54.267299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 464/935] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Sep 19 16:57:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:54.274118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7dd9b-777f-4c88-a335-37cac849d926 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:54.386244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7dd9b-777f-4c88-a335-37cac849d926 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:54.398210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:54.425051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc72096-6066-4661-8467-65d58c318c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:54.425728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc72096-6066-4661-8467-65d58c318c2a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:54.426221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc72096-6066-4661-8467-65d58c318c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:54.426682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc72096-6066-4661-8467-65d58c318c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:54.432246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b0ba-da1c-4985-8741-14276063109b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:54.432804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b0ba-da1c-4985-8741-14276063109b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:54.433329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b0ba-da1c-4985-8741-14276063109b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:54.435138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 465/936] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:54.439374 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc72096-6066-4661-8467-65d58c318c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:54.440837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc72096-6066-4661-8467-65d58c318c2a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:54.441200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171dec9-748b-417d-bd78-337db935bffd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:54.441740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171dec9-748b-417d-bd78-337db935bffd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:54.442206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171dec9-748b-417d-bd78-337db935bffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:54.449070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-cbc72096-6066-4661-8467-65d58c318c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:54.458292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:54.459264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:54.460159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:54.460159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:54.460159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:54.460159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 472/937] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:54.465301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc72096-6066-4661-8467-65d58c318c2a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:54.466815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8171dec9-748b-417d-bd78-337db935bffd None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:54.468419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8171dec9-748b-417d-bd78-337db935bffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:54.569506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 466/938] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:57:54.588013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc72096-6066-4661-8467-65d58c318c2a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:54.623212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c7cb6-ab5e-4455-9a1c-c24a89e79de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:54.623833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c7cb6-ab5e-4455-9a1c-c24a89e79de0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:54.624116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c7cb6-ab5e-4455-9a1c-c24a89e79de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:54.624389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c7cb6-ab5e-4455-9a1c-c24a89e79de0 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:54.625055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c7cb6-ab5e-4455-9a1c-c24a89e79de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:54.625428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c7cb6-ab5e-4455-9a1c-c24a89e79de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:54.626871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c7cb6-ab5e-4455-9a1c-c24a89e79de0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:54.639497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 473/939] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:54.648344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171dec9-748b-417d-bd78-337db935bffd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:54.752482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171dec9-748b-417d-bd78-337db935bffd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:54.783657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:54.789504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e6042-0c46-4130-b3c6-f2d438f42a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:54.791722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6042-0c46-4130-b3c6-f2d438f42a42 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:54.791722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6042-0c46-4130-b3c6-f2d438f42a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:54.791722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6042-0c46-4130-b3c6-f2d438f42a42 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:54.799698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6042-0c46-4130-b3c6-f2d438f42a42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:54.801640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6042-0c46-4130-b3c6-f2d438f42a42 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c86e6042-0c46-4130-b3c6-f2d438f42a42 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:54.813866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:54.814994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:54.816350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:54.816350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:54.816350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:54.816350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:54.816350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:54.816350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:54.816350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:54.816350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:54.816350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:54.816350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:54.818671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 467/940] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Sep 19 16:57:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:54.824860 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c7cb6-ab5e-4455-9a1c-c24a89e79de0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:54.848272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:54.876914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e6042-0c46-4130-b3c6-f2d438f42a42 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:54.946700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c7cb6-ab5e-4455-9a1c-c24a89e79de0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:54.980783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e6042-0c46-4130-b3c6-f2d438f42a42 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:54.985628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc22d14-eb4b-4d43-9fe0-d2663a5ec200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:54.986257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc22d14-eb4b-4d43-9fe0-d2663a5ec200 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:54.986533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc22d14-eb4b-4d43-9fe0-d2663a5ec200 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:54.986805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc22d14-eb4b-4d43-9fe0-d2663a5ec200 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:54.987548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc22d14-eb4b-4d43-9fe0-d2663a5ec200 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:54.987851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc22d14-eb4b-4d43-9fe0-d2663a5ec200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:54.989390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc22d14-eb4b-4d43-9fe0-d2663a5ec200 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:55.017127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 474/941] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Sep 19 16:57:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:55.018665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc22d14-eb4b-4d43-9fe0-d2663a5ec200 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:55.028355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:55.028988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:55.029308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:55.029580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:55.031055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:55.032569 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:55.035712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: WARNING keystone.server.flask.common [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 16:57:55.062555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.sql.core [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 16:57:55.062555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 16:57:55.062555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [parameters: {'id': 'ff90a80ccd4a42b9872d2f75240cd9ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 16:57:55.062555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81586) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff90a80ccd4a42b9872d2f75240cd9ff.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff90a80ccd4a42b9872d2f75240cd9ff. Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:57:55.078840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result.read() Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 19 16:57:55.079689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application yield resource Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise self.value Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application session.commit() Sep 19 16:57:55.080697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.session.flush() Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application compat.raise_( Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 16:57:55.081662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 16:57:55.083312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result.read() Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:57:55.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [parameters: {'id': 'ff90a80ccd4a42b9872d2f75240cd9ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:55.085947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:55.087860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff90a80ccd4a42b9872d2f75240cd9ff. Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 468/942] 10.222.0.76 () {60 vars in 1140 bytes} [Mon Sep 19 16:57:54 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:55.090014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:55.131340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:55.142443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:55.166471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc22d14-eb4b-4d43-9fe0-d2663a5ec200 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:55.204861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8743ac-da2e-4667-9dd1-84056f6bae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:55.205889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8743ac-da2e-4667-9dd1-84056f6bae6e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:55.206100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8743ac-da2e-4667-9dd1-84056f6bae6e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:55.206466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8743ac-da2e-4667-9dd1-84056f6bae6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:55.212450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf383a7-4b41-4013-831f-40295602ba1d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:55.218064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8743ac-da2e-4667-9dd1-84056f6bae6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:55.219638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8743ac-da2e-4667-9dd1-84056f6bae6e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7f8743ac-da2e-4667-9dd1-84056f6bae6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:55.235763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:55.236961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:55.238099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:55.238099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:55.238099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:55.243866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 475/943] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:55.245146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8743ac-da2e-4667-9dd1-84056f6bae6e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:55.257182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222896c-9fc8-45f9-b48c-35646d8253ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:55.258374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222896c-9fc8-45f9-b48c-35646d8253ec None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:55.258801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222896c-9fc8-45f9-b48c-35646d8253ec None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:55.259597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222896c-9fc8-45f9-b48c-35646d8253ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:55.268407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222896c-9fc8-45f9-b48c-35646d8253ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:55.271405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222896c-9fc8-45f9-b48c-35646d8253ec None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7222896c-9fc8-45f9-b48c-35646d8253ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:55.286087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:55.287157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:55.288290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:55.288290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:55.288290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:55.288290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:55.288290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:55.288290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:55.288290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:55.288290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:55.290301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 469/944] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:55.296586 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222896c-9fc8-45f9-b48c-35646d8253ec None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:55.372702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8743ac-da2e-4667-9dd1-84056f6bae6e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:55.405272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:55.409784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222896c-9fc8-45f9-b48c-35646d8253ec None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:55.412623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f53cca-426e-45e8-88ed-20fa4578a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:55.414291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f53cca-426e-45e8-88ed-20fa4578a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:55.414291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f53cca-426e-45e8-88ed-20fa4578a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:55.414291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f53cca-426e-45e8-88ed-20fa4578a6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:55.415063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f53cca-426e-45e8-88ed-20fa4578a6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:55.415452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f53cca-426e-45e8-88ed-20fa4578a6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:55.416904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f53cca-426e-45e8-88ed-20fa4578a6e2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:55.421676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:55.433072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 476/945] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:55.435668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f53cca-426e-45e8-88ed-20fa4578a6e2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:55.460430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a805d-f5f3-42c7-8127-051f1f59ba5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:55.461073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a805d-f5f3-42c7-8127-051f1f59ba5a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:55.461349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a805d-f5f3-42c7-8127-051f1f59ba5a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:55.461622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a805d-f5f3-42c7-8127-051f1f59ba5a None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:55.462289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a805d-f5f3-42c7-8127-051f1f59ba5a None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:55.462585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a805d-f5f3-42c7-8127-051f1f59ba5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:55.464713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a805d-f5f3-42c7-8127-051f1f59ba5a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:55.497402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 470/946] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:57:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:55.558109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f53cca-426e-45e8-88ed-20fa4578a6e2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:55.596010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46858139-fe22-469a-9c64-fde0538b6ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:55.597378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46858139-fe22-469a-9c64-fde0538b6ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:55.597899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46858139-fe22-469a-9c64-fde0538b6ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:55.598368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46858139-fe22-469a-9c64-fde0538b6ef5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:55.606490 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46858139-fe22-469a-9c64-fde0538b6ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:55.608346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46858139-fe22-469a-9c64-fde0538b6ef5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-46858139-fe22-469a-9c64-fde0538b6ef5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:57:55.621277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:55.622234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:55.623195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:57:55.623195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:57:55.623195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:57:55.623195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:57:55.623195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:57:55.623195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:57:55.623195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:57:55.623195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:55.630560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 477/947] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:55.632324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a805d-f5f3-42c7-8127-051f1f59ba5a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:55.738657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a805d-f5f3-42c7-8127-051f1f59ba5a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:55.776130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbc286-ffb0-4cfc-b123-69a2ad260635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:55.776751 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbc286-ffb0-4cfc-b123-69a2ad260635 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:55.777026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbc286-ffb0-4cfc-b123-69a2ad260635 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:55.777345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbc286-ffb0-4cfc-b123-69a2ad260635 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:55.778047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbc286-ffb0-4cfc-b123-69a2ad260635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:55.778343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbc286-ffb0-4cfc-b123-69a2ad260635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:55.779781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbc286-ffb0-4cfc-b123-69a2ad260635 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:55.792286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 471/948] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:57:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:55.798298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46858139-fe22-469a-9c64-fde0538b6ef5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:55.851437 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:55.903519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46858139-fe22-469a-9c64-fde0538b6ef5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:55.937964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7cdbb-65b8-4e1a-aad3-cfdeac1a515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:55.938638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7cdbb-65b8-4e1a-aad3-cfdeac1a515f None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:55.938917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7cdbb-65b8-4e1a-aad3-cfdeac1a515f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:55.939191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7cdbb-65b8-4e1a-aad3-cfdeac1a515f None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/ee58334347c34e329ac250ae9e73aa93/roles/df4a78a83b4846d5b311f4b9f038b434` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:55.943255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7cdbb-65b8-4e1a-aad3-cfdeac1a515f None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=ee58334347c34e329ac250ae9e73aa93, role_id=df4a78a83b4846d5b311f4b9f038b434)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:55.944755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7cdbb-65b8-4e1a-aad3-cfdeac1a515f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:55.969252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 478/949] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:57:55 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/ee58334347c34e329ac250ae9e73aa93/roles/df4a78a83b4846d5b311f4b9f038b434 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:57:56.289016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb4a5b-89bf-4206-8ed0-50a8069d6308 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:56.289566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb4a5b-89bf-4206-8ed0-50a8069d6308 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:56.289566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb4a5b-89bf-4206-8ed0-50a8069d6308 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:56.291177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 472/950] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:56.296760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbebbf-ad01-42bc-8f0a-b03f13f3b699 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:56.297057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbebbf-ad01-42bc-8f0a-b03f13f3b699 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:56.297348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbebbf-ad01-42bc-8f0a-b03f13f3b699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:56.301708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ded09-db41-40d7-bc2e-dfcd6706df36 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:56.301991 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ded09-db41-40d7-bc2e-dfcd6706df36 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:56.302257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ded09-db41-40d7-bc2e-dfcd6706df36 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:56.303837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 473/951] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:56.310528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb48e-67c6-4dd7-ba37-d9245072d9f4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:56.310812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb48e-67c6-4dd7-ba37-d9245072d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:56.311084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb48e-67c6-4dd7-ba37-d9245072d9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:56.317684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e5dbebbf-ad01-42bc-8f0a-b03f13f3b699 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:56.318882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e5dbebbf-ad01-42bc-8f0a-b03f13f3b699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:56.330064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0eafb48e-67c6-4dd7-ba37-d9245072d9f4 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:56.331784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0eafb48e-67c6-4dd7-ba37-d9245072d9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:56.359140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:56.391396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 479/952] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:56.413171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 474/953] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:57:56.655290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbebbf-ad01-42bc-8f0a-b03f13f3b699 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:56.691350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafb48e-67c6-4dd7-ba37-d9245072d9f4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:56.702618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:56.778270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbebbf-ad01-42bc-8f0a-b03f13f3b699 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:56.801756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafb48e-67c6-4dd7-ba37-d9245072d9f4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:56.814828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d657ed-e5c2-4916-ae1c-1d906a467825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:56.815999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d657ed-e5c2-4916-ae1c-1d906a467825 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:56.816472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d657ed-e5c2-4916-ae1c-1d906a467825 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:56.817079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d657ed-e5c2-4916-ae1c-1d906a467825 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:56.817849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d657ed-e5c2-4916-ae1c-1d906a467825 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:56.819348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d657ed-e5c2-4916-ae1c-1d906a467825 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-39d657ed-e5c2-4916-ae1c-1d906a467825 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:56.828368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:56.829602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:57:56.830479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:56.833326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 480/954] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:57:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:56.835534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d657ed-e5c2-4916-ae1c-1d906a467825 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:56.858113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aab14-b271-4eaf-b1c2-8f2c0f39c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:56.859320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aab14-b271-4eaf-b1c2-8f2c0f39c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:56.859770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aab14-b271-4eaf-b1c2-8f2c0f39c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:56.860439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aab14-b271-4eaf-b1c2-8f2c0f39c9b7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:56.861601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aab14-b271-4eaf-b1c2-8f2c0f39c9b7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:56.863251 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aab14-b271-4eaf-b1c2-8f2c0f39c9b7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-963aab14-b271-4eaf-b1c2-8f2c0f39c9b7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:56.877299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:56.878392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:57:56.879369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:56.882055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 475/955] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:57:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:57:56.888798 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aab14-b271-4eaf-b1c2-8f2c0f39c9b7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:56.914658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:56.966710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d657ed-e5c2-4916-ae1c-1d906a467825 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:56.970652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:57.007359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aab14-b271-4eaf-b1c2-8f2c0f39c9b7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:57.007548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f8f29-c465-4c04-95ea-ee50109d428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:57.008198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f8f29-c465-4c04-95ea-ee50109d428e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:57.008567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f8f29-c465-4c04-95ea-ee50109d428e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:57.008930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f8f29-c465-4c04-95ea-ee50109d428e None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:57.009844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f8f29-c465-4c04-95ea-ee50109d428e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:57.010278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f8f29-c465-4c04-95ea-ee50109d428e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:57.012560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f8f29-c465-4c04-95ea-ee50109d428e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:57.022941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 481/956] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:57:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:57.023911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f8f29-c465-4c04-95ea-ee50109d428e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:57.052888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8468055-f2e8-498b-94be-3882b2c24fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:57.054144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8468055-f2e8-498b-94be-3882b2c24fae None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:57.054819 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8468055-f2e8-498b-94be-3882b2c24fae None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:57.055232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8468055-f2e8-498b-94be-3882b2c24fae None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:57.056240 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8468055-f2e8-498b-94be-3882b2c24fae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:57.057084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8468055-f2e8-498b-94be-3882b2c24fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:57.058871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8468055-f2e8-498b-94be-3882b2c24fae None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:57.070174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 476/957] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Sep 19 16:57:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:57.076259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8468055-f2e8-498b-94be-3882b2c24fae None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:57.141281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f8f29-c465-4c04-95ea-ee50109d428e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:57.174771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:57.181398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac13f89-fdb3-4688-9ef7-9d4bfb36412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:57.182099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac13f89-fdb3-4688-9ef7-9d4bfb36412a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:57.182445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac13f89-fdb3-4688-9ef7-9d4bfb36412a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:57.182839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac13f89-fdb3-4688-9ef7-9d4bfb36412a None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:57.183530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac13f89-fdb3-4688-9ef7-9d4bfb36412a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:57.183923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac13f89-fdb3-4688-9ef7-9d4bfb36412a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:57.185431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac13f89-fdb3-4688-9ef7-9d4bfb36412a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:57.190737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 482/958] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:57:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:57.199079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8468055-f2e8-498b-94be-3882b2c24fae None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:57.238508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeeeef2-41a2-4389-a193-a8b6efcdb446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:57.239385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeeef2-41a2-4389-a193-a8b6efcdb446 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:57.239832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeeef2-41a2-4389-a193-a8b6efcdb446 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:57.240260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeeef2-41a2-4389-a193-a8b6efcdb446 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:57.241074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeeeef2-41a2-4389-a193-a8b6efcdb446 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:57.241528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeeeef2-41a2-4389-a193-a8b6efcdb446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:57.243186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeeeef2-41a2-4389-a193-a8b6efcdb446 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:57.249930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 477/959] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Sep 19 16:57:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:57:57.262261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac13f89-fdb3-4688-9ef7-9d4bfb36412a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:57.300366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:57.376044 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac13f89-fdb3-4688-9ef7-9d4bfb36412a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:57.413589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758807a-6e8c-44d4-80c8-b9533f49770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:57.414506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758807a-6e8c-44d4-80c8-b9533f49770a None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:57.414938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758807a-6e8c-44d4-80c8-b9533f49770a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:57.415369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758807a-6e8c-44d4-80c8-b9533f49770a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:57.416190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758807a-6e8c-44d4-80c8-b9533f49770a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:57.417737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758807a-6e8c-44d4-80c8-b9533f49770a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:57.442350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 483/960] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 16:57:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:57:57.783899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1823be-7d42-43ae-9417-9309502e3d71 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:57.784436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1823be-7d42-43ae-9417-9309502e3d71 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:57.784436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1823be-7d42-43ae-9417-9309502e3d71 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:57.786098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 478/961] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:57.791727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9b36c-58e5-4fe4-b87d-62dab0a12182 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:57.792023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9b36c-58e5-4fe4-b87d-62dab0a12182 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:57.792301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9b36c-58e5-4fe4-b87d-62dab0a12182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:57.810651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-10a9b36c-58e5-4fe4-b87d-62dab0a12182 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:57.811845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-10a9b36c-58e5-4fe4-b87d-62dab0a12182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:57.889554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 484/962] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:58.149803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233e646-238f-4615-a3cf-c4fa1abb9a0c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:58.150083 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233e646-238f-4615-a3cf-c4fa1abb9a0c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:58.150358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233e646-238f-4615-a3cf-c4fa1abb9a0c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:58.152010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 479/963] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:58.156944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233e646-238f-4615-a3cf-c4fa1abb9a0c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:58.157695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f5edd-6740-4d82-9277-7f4f52766d62 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:58.158481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f5edd-6740-4d82-9277-7f4f52766d62 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:58.158898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f5edd-6740-4d82-9277-7f4f52766d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:58.178326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-380f5edd-6740-4d82-9277-7f4f52766d62 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:58.179907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-380f5edd-6740-4d82-9277-7f4f52766d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:58.190751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:58.267275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233e646-238f-4615-a3cf-c4fa1abb9a0c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:58.268642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 485/964] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:58.302910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c01a80-e60d-4467-8977-6577662fe947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:58.303838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c01a80-e60d-4467-8977-6577662fe947 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:58.304316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c01a80-e60d-4467-8977-6577662fe947 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:58.304759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c01a80-e60d-4467-8977-6577662fe947 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:58.305614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c01a80-e60d-4467-8977-6577662fe947 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:58.307220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c01a80-e60d-4467-8977-6577662fe947 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:58.323262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.sql.core [None req-f6c01a80-e60d-4467-8977-6577662fe947 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 16:57:58.323262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 16:57:58.323262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [parameters: {'user_id': '799c55b120304700a6d9c20ade790a8a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 16:57:58.323262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81586) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f6c01a80-e60d-4467-8977-6577662fe947 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result.read() Sep 19 16:57:58.331668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:57:58.332878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application yield resource Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application next(self.gen) Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise self.value Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application session.commit() Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 16:57:58.334188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.session.flush() Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application compat.raise_( Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 16:57:58.335331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 16:57:58.336361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application conn.query(q) Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application result.read() Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 16:57:58.337441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [parameters: {'user_id': '799c55b120304700a6d9c20ade790a8a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:58.338294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 19 16:57:58.339174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 19 16:57:58.340227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 19 16:57:58.340227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 19 16:57:58.340227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 16:57:58.340227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 16:57:58.340227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 16:57:58.340227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:58.342571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 480/965] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Sep 19 16:57:58 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:58.351256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f5edd-6740-4d82-9277-7f4f52766d62 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:58.457232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f5edd-6740-4d82-9277-7f4f52766d62 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:58.492410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e9ca0-c84d-47e0-9294-5efdd00f0a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:58.493390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e9ca0-c84d-47e0-9294-5efdd00f0a1e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:58.493868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e9ca0-c84d-47e0-9294-5efdd00f0a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:58.494314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e9ca0-c84d-47e0-9294-5efdd00f0a1e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:58.501802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e9ca0-c84d-47e0-9294-5efdd00f0a1e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:58.503466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e9ca0-c84d-47e0-9294-5efdd00f0a1e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-9c6e9ca0-c84d-47e0-9294-5efdd00f0a1e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:58.516276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:58.517263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:58.518213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:58.518213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:58.518213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:58.518213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:58.518213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:58.518213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:58.518213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:58.518213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:58.518213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 16:57:58.518213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:58.521006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 486/966] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:57:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:58.528583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c01a80-e60d-4467-8977-6577662fe947 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:58.538045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e9ca0-c84d-47e0-9294-5efdd00f0a1e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:58.542618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:58.547889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:58.642588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e9ca0-c84d-47e0-9294-5efdd00f0a1e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:58.668636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c01a80-e60d-4467-8977-6577662fe947 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:58.678783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992798e-cbb9-4e6b-b222-8781b60fe184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:58.679247 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992798e-cbb9-4e6b-b222-8781b60fe184 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:58.679596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992798e-cbb9-4e6b-b222-8781b60fe184 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:58.679940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992798e-cbb9-4e6b-b222-8781b60fe184 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:58.690394 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992798e-cbb9-4e6b-b222-8781b60fe184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5992798e-cbb9-4e6b-b222-8781b60fe184 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:57:58.695851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:58.696792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:57:58.697668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:57:58.701811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 487/967] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Sep 19 16:57:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:58.703759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992798e-cbb9-4e6b-b222-8781b60fe184 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:58.714673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447e28d-2ecf-4c7e-b805-f543bab22c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:58.715858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447e28d-2ecf-4c7e-b805-f543bab22c0f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:58.716338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447e28d-2ecf-4c7e-b805-f543bab22c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:58.717071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447e28d-2ecf-4c7e-b805-f543bab22c0f None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:58.718224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447e28d-2ecf-4c7e-b805-f543bab22c0f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:58.718674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447e28d-2ecf-4c7e-b805-f543bab22c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:58.721252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447e28d-2ecf-4c7e-b805-f543bab22c0f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:58.771705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 481/968] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Sep 19 16:57:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:58.773256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:58.811387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992798e-cbb9-4e6b-b222-8781b60fe184 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:58.850292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf541-bcd7-4841-8939-60e6dabcdc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:58.851324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf541-bcd7-4841-8939-60e6dabcdc02 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:58.851828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf541-bcd7-4841-8939-60e6dabcdc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:58.852325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311cf541-bcd7-4841-8939-60e6dabcdc02 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:58.853310 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cf541-bcd7-4841-8939-60e6dabcdc02 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:58.853819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cf541-bcd7-4841-8939-60e6dabcdc02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:58.855436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311cf541-bcd7-4841-8939-60e6dabcdc02 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:58.865533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 488/969] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Sep 19 16:57:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:58.874265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447e28d-2ecf-4c7e-b805-f543bab22c0f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:58.952547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:58.987705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447e28d-2ecf-4c7e-b805-f543bab22c0f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:59.023065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aad56-6c13-4f15-8f63-43a3b66000fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:59.023719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aad56-6c13-4f15-8f63-43a3b66000fb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:59.023993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aad56-6c13-4f15-8f63-43a3b66000fb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:59.024273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aad56-6c13-4f15-8f63-43a3b66000fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:59.035913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20aad56-6c13-4f15-8f63-43a3b66000fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:59.037460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20aad56-6c13-4f15-8f63-43a3b66000fb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a20aad56-6c13-4f15-8f63-43a3b66000fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:57:59.052523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:59.053585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:57:59.054651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:57:59.054651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:57:59.054651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:59.054651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 482/970] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:59.061016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf541-bcd7-4841-8939-60e6dabcdc02 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:59.173052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311cf541-bcd7-4841-8939-60e6dabcdc02 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:59.199744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:59.209507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555dae4-af6e-4cda-b8a9-4e312ad56579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:59.210121 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555dae4-af6e-4cda-b8a9-4e312ad56579 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:59.210399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555dae4-af6e-4cda-b8a9-4e312ad56579 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:59.210666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555dae4-af6e-4cda-b8a9-4e312ad56579 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:59.211312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555dae4-af6e-4cda-b8a9-4e312ad56579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:59.211610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555dae4-af6e-4cda-b8a9-4e312ad56579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:59.212982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555dae4-af6e-4cda-b8a9-4e312ad56579 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:59.229891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 489/971] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:59.231507 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aad56-6c13-4f15-8f63-43a3b66000fb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:59.339780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aad56-6c13-4f15-8f63-43a3b66000fb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:59.364458 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:59.377691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799abe8-e81c-41fa-bf79-531365025f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:59.378334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799abe8-e81c-41fa-bf79-531365025f45 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:59.378607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799abe8-e81c-41fa-bf79-531365025f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:59.378879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799abe8-e81c-41fa-bf79-531365025f45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:59.386847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799abe8-e81c-41fa-bf79-531365025f45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:59.388299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799abe8-e81c-41fa-bf79-531365025f45 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9799abe8-e81c-41fa-bf79-531365025f45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:57:59.399631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:57:59.400584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:57:59.401589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:57:59.401589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:57:59.401589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:57:59.401589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:57:59.401589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:57:59.401589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:57:59.401589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:57:59.401589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:57:59.401589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 16:57:59.401589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:57:59.405110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 483/972] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Sep 19 16:57:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:57:59.406808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555dae4-af6e-4cda-b8a9-4e312ad56579 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:59.445503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ced42c-d919-46dc-a7e6-1f1548df0e7b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:59.445789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ced42c-d919-46dc-a7e6-1f1548df0e7b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:59.446067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ced42c-d919-46dc-a7e6-1f1548df0e7b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:59.447561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 484/973] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:57:59.452488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7bc4c-f164-4499-b5dc-a6eff146c6bd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:59.452765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7bc4c-f164-4499-b5dc-a6eff146c6bd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:59.453065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7bc4c-f164-4499-b5dc-a6eff146c6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:59.473280 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0ab7bc4c-f164-4499-b5dc-a6eff146c6bd None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:59.475004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0ab7bc4c-f164-4499-b5dc-a6eff146c6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:59.512928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555dae4-af6e-4cda-b8a9-4e312ad56579 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:59.550437 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6510b34-352d-417f-8d99-34cc534efd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:59.551114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6510b34-352d-417f-8d99-34cc534efd0f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:59.551441 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6510b34-352d-417f-8d99-34cc534efd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:59.551668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6510b34-352d-417f-8d99-34cc534efd0f None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:59.552397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6510b34-352d-417f-8d99-34cc534efd0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:57:59.552705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6510b34-352d-417f-8d99-34cc534efd0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:59.560777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 485/974] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:57:59.560947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6510b34-352d-417f-8d99-34cc534efd0f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:59.576453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 490/975] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Sep 19 16:57:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:57:59.578147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7bc4c-f164-4499-b5dc-a6eff146c6bd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:59.615111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1928c-ed68-4345-8ce2-dfd577396936 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:59.615403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1928c-ed68-4345-8ce2-dfd577396936 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:59.615571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1928c-ed68-4345-8ce2-dfd577396936 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:59.617058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 491/976] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:57:59.621765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcd830-742d-4432-a47b-d3de0574c6df None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:59.622059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcd830-742d-4432-a47b-d3de0574c6df None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:59.622331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcd830-742d-4432-a47b-d3de0574c6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:59.642661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8bdcd830-742d-4432-a47b-d3de0574c6df None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:57:59.643877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8bdcd830-742d-4432-a47b-d3de0574c6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:57:59.678483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7bc4c-f164-4499-b5dc-a6eff146c6bd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:59.688041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:59.692761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:59.716932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfbf77-9fbe-4789-b9c7-d2984de50b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:59.717576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfbf77-9fbe-4789-b9c7-d2984de50b06 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:59.717847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfbf77-9fbe-4789-b9c7-d2984de50b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:59.718259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 492/977] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:57:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:57:59.721267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfbf77-9fbe-4789-b9c7-d2984de50b06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:59.790940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfbf77-9fbe-4789-b9c7-d2984de50b06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:59.792405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfbf77-9fbe-4789-b9c7-d2984de50b06 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:59.821916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcd830-742d-4432-a47b-d3de0574c6df None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:59.898502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 486/978] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:57:59 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:57:59.901006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfbf77-9fbe-4789-b9c7-d2984de50b06 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:57:59.915077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:57:59.929958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcd830-742d-4432-a47b-d3de0574c6df None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:57:59.966784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaaeb3-15b7-4896-897d-cbc84d0b568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:57:59.967650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaaeb3-15b7-4896-897d-cbc84d0b568f None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:57:59.968078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaaeb3-15b7-4896-897d-cbc84d0b568f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:57:59.968529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaaeb3-15b7-4896-897d-cbc84d0b568f None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:57:59.969216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaaeb3-15b7-4896-897d-cbc84d0b568f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:57:59.970598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaaeb3-15b7-4896-897d-cbc84d0b568f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:57:59.989090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 493/979] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:57:59 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:58:00.000510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaaeb3-15b7-4896-897d-cbc84d0b568f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:00.008007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfbf77-9fbe-4789-b9c7-d2984de50b06 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:00.040585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:00.058203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dcefd-d1d5-433b-8623-e61e2530986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:00.058964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dcefd-d1d5-433b-8623-e61e2530986b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:00.059243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dcefd-d1d5-433b-8623-e61e2530986b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:00.059509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dcefd-d1d5-433b-8623-e61e2530986b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:00.070859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dcefd-d1d5-433b-8623-e61e2530986b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:00.072347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6dcefd-d1d5-433b-8623-e61e2530986b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-cb6dcefd-d1d5-433b-8623-e61e2530986b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:58:00.088363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:00.089605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:58:00.090597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:58:00.090597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:00.090597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:00.090597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 487/980] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:58:00.096594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dcefd-d1d5-433b-8623-e61e2530986b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:00.123802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaaeb3-15b7-4896-897d-cbc84d0b568f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:00.164059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f9a4e-af1b-4ad6-a3ee-4c7b15b39a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:00.164720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9a4e-af1b-4ad6-a3ee-4c7b15b39a7a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:00.165100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9a4e-af1b-4ad6-a3ee-4c7b15b39a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:00.165520 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9a4e-af1b-4ad6-a3ee-4c7b15b39a7a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:00.166181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f9a4e-af1b-4ad6-a3ee-4c7b15b39a7a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:00.167709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f9a4e-af1b-4ad6-a3ee-4c7b15b39a7a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-9f0f9a4e-af1b-4ad6-a3ee-4c7b15b39a7a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:00.177387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:00.179651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:00.180677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 494/981] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:57:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:58:00.186447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:00.187686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f9a4e-af1b-4ad6-a3ee-4c7b15b39a7a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:00.234110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dcefd-d1d5-433b-8623-e61e2530986b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:00.271392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5e88e-7d87-448e-9658-ff95433f96dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:00.272224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5e88e-7d87-448e-9658-ff95433f96dd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:00.272363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5e88e-7d87-448e-9658-ff95433f96dd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:00.272545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5e88e-7d87-448e-9658-ff95433f96dd None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:00.273211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5e88e-7d87-448e-9658-ff95433f96dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:00.273513 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5e88e-7d87-448e-9658-ff95433f96dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:00.274934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5e88e-7d87-448e-9658-ff95433f96dd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:00.287847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 488/982] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:00.292957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5e88e-7d87-448e-9658-ff95433f96dd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:00.295934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:00.300131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f9a4e-af1b-4ad6-a3ee-4c7b15b39a7a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:00.336207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945977-db8b-44ce-ae3c-7b1ed7de3e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:00.336821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945977-db8b-44ce-ae3c-7b1ed7de3e34 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:00.337123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945977-db8b-44ce-ae3c-7b1ed7de3e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:00.337396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945977-db8b-44ce-ae3c-7b1ed7de3e34 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:00.338022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c945977-db8b-44ce-ae3c-7b1ed7de3e34 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:00.338312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c945977-db8b-44ce-ae3c-7b1ed7de3e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:00.339681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c945977-db8b-44ce-ae3c-7b1ed7de3e34 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:00.344574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 495/983] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Sep 19 16:58:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:00.350330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945977-db8b-44ce-ae3c-7b1ed7de3e34 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:00.398480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5e88e-7d87-448e-9658-ff95433f96dd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:00.420680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:00.435621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c58d6-95cf-4fcf-bbfb-4b7ca5a9f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:00.436256 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c58d6-95cf-4fcf-bbfb-4b7ca5a9f122 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:00.436528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c58d6-95cf-4fcf-bbfb-4b7ca5a9f122 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:00.436800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c58d6-95cf-4fcf-bbfb-4b7ca5a9f122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:00.443555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c58d6-95cf-4fcf-bbfb-4b7ca5a9f122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:00.444995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c58d6-95cf-4fcf-bbfb-4b7ca5a9f122 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-487c58d6-95cf-4fcf-bbfb-4b7ca5a9f122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:58:00.456069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:00.456985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:00.457967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:58:00.457967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:58:00.457967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:58:00.457967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:58:00.457967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:58:00.457967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:58:00.457967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:58:00.457967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:00.462104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 489/984] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:58:00.462215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945977-db8b-44ce-ae3c-7b1ed7de3e34 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:00.462767 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c58d6-95cf-4fcf-bbfb-4b7ca5a9f122 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:00.499537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d218cc2-b907-43b5-bb4e-497bfc1c8dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:00.499537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d218cc2-b907-43b5-bb4e-497bfc1c8dba None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:00.499537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d218cc2-b907-43b5-bb4e-497bfc1c8dba None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:00.499537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d218cc2-b907-43b5-bb4e-497bfc1c8dba None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:00.500113 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d218cc2-b907-43b5-bb4e-497bfc1c8dba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:00.500293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d218cc2-b907-43b5-bb4e-497bfc1c8dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:00.501700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d218cc2-b907-43b5-bb4e-497bfc1c8dba None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:00.507005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 496/985] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Sep 19 16:58:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:00.512601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d218cc2-b907-43b5-bb4e-497bfc1c8dba None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:00.541283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:00.566142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c58d6-95cf-4fcf-bbfb-4b7ca5a9f122 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:00.602707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f6680-eacf-400c-bde4-5a666f7525b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:00.603324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f6680-eacf-400c-bde4-5a666f7525b1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:00.603590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f6680-eacf-400c-bde4-5a666f7525b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:00.603865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f6680-eacf-400c-bde4-5a666f7525b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:00.604600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f6680-eacf-400c-bde4-5a666f7525b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:00.604911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f6680-eacf-400c-bde4-5a666f7525b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:00.606401 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f6680-eacf-400c-bde4-5a666f7525b1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:00.621086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 490/986] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:00.624337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f6680-eacf-400c-bde4-5a666f7525b1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:00.625999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d218cc2-b907-43b5-bb4e-497bfc1c8dba None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:00.662049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c8d5a-241f-4e6d-b6dd-8005c73d5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:00.662668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c8d5a-241f-4e6d-b6dd-8005c73d5adf None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:00.662943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c8d5a-241f-4e6d-b6dd-8005c73d5adf None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:00.663209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c8d5a-241f-4e6d-b6dd-8005c73d5adf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:00.663915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c8d5a-241f-4e6d-b6dd-8005c73d5adf None admin] RBAC: Adding query filter params (interface=admin, service_id=98de4da1ee8645d9a8479d914db7c616, region_id=RegionOne) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:00.664333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c8d5a-241f-4e6d-b6dd-8005c73d5adf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:00.665724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c8d5a-241f-4e6d-b6dd-8005c73d5adf None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:00.666459 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:00.677135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 497/987] 10.222.0.76 () {56 vars in 1249 bytes} [Mon Sep 19 16:58:00 2022] GET /identity/v3/endpoints?service_id=98de4da1ee8645d9a8479d914db7c616&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:00.678530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c8d5a-241f-4e6d-b6dd-8005c73d5adf None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:00.739488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f6680-eacf-400c-bde4-5a666f7525b1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:00.771554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:00.779113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed1edb-b67d-4f23-bac3-f9f95a0f082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:00.780417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1edb-b67d-4f23-bac3-f9f95a0f082c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:00.781111 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1edb-b67d-4f23-bac3-f9f95a0f082c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:00.781551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed1edb-b67d-4f23-bac3-f9f95a0f082c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:00.782449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed1edb-b67d-4f23-bac3-f9f95a0f082c None admin] RBAC: Adding query filter params (role.id=df4a78a83b4846d5b311f4b9f038b434, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=ee58334347c34e329ac250ae9e73aa93) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:00.782751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c8d5a-241f-4e6d-b6dd-8005c73d5adf None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:00.783070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed1edb-b67d-4f23-bac3-f9f95a0f082c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:00.785352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed1edb-b67d-4f23-bac3-f9f95a0f082c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:00.791491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 491/988] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:58:00 2022] GET /identity/v3/role_assignments?user.id=ee58334347c34e329ac250ae9e73aa93&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=df4a78a83b4846d5b311f4b9f038b434 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:00.819959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2f841-0192-4568-9095-046b1d062b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:00.820604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2f841-0192-4568-9095-046b1d062b79 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:00.820885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2f841-0192-4568-9095-046b1d062b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:00.821204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2f841-0192-4568-9095-046b1d062b79 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:00.821834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2f841-0192-4568-9095-046b1d062b79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:00.823248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2f841-0192-4568-9095-046b1d062b79 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:00.830604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 498/989] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Sep 19 16:58:00 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 16:58:02.159748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe50b8b-1622-4ef6-8782-8adda8c27b8a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:02.160258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe50b8b-1622-4ef6-8782-8adda8c27b8a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:02.160340 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe50b8b-1622-4ef6-8782-8adda8c27b8a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:02.161725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 492/990] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:02.167111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10fb1-a9fe-4b26-8a0d-b210405bd0e1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:02.167527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10fb1-a9fe-4b26-8a0d-b210405bd0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:02.167740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10fb1-a9fe-4b26-8a0d-b210405bd0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:02.186393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b7b10fb1-a9fe-4b26-8a0d-b210405bd0e1 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:02.187572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b7b10fb1-a9fe-4b26-8a0d-b210405bd0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:02.256292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 499/991] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:02.516250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe50b8b-1622-4ef6-8782-8adda8c27b8a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:02.625453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe50b8b-1622-4ef6-8782-8adda8c27b8a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:02.627945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:02.662630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a734d6-f5a4-4685-99f9-2df7c1024a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:02.663268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a734d6-f5a4-4685-99f9-2df7c1024a8c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:02.663543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a734d6-f5a4-4685-99f9-2df7c1024a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:02.663813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a734d6-f5a4-4685-99f9-2df7c1024a8c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:02.664390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a734d6-f5a4-4685-99f9-2df7c1024a8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:02.665798 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a734d6-f5a4-4685-99f9-2df7c1024a8c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d6a734d6-f5a4-4685-99f9-2df7c1024a8c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:02.675085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:02.676102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:02.677978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 493/992] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:58:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:02.682742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10fb1-a9fe-4b26-8a0d-b210405bd0e1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:02.769594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:02.786990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10fb1-a9fe-4b26-8a0d-b210405bd0e1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:02.822411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ae232-563d-4e3f-865f-6c3a91add1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:02.823033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ae232-563d-4e3f-865f-6c3a91add1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:02.823320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ae232-563d-4e3f-865f-6c3a91add1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:02.823592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ae232-563d-4e3f-865f-6c3a91add1f8 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:02.824222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ae232-563d-4e3f-865f-6c3a91add1f8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:02.824520 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ae232-563d-4e3f-865f-6c3a91add1f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:02.825938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ae232-563d-4e3f-865f-6c3a91add1f8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:02.831214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 500/993] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:58:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:02.837152 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a734d6-f5a4-4685-99f9-2df7c1024a8c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:02.949371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a734d6-f5a4-4685-99f9-2df7c1024a8c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:02.983312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bc7e3-7272-4d9d-bbe2-97b438e41de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:02.983923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bc7e3-7272-4d9d-bbe2-97b438e41de1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:02.984204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bc7e3-7272-4d9d-bbe2-97b438e41de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:02.984482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bc7e3-7272-4d9d-bbe2-97b438e41de1 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:02.985148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bc7e3-7272-4d9d-bbe2-97b438e41de1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:02.985431 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bc7e3-7272-4d9d-bbe2-97b438e41de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:02.986812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bc7e3-7272-4d9d-bbe2-97b438e41de1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:02.995972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 494/994] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:58:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:02.996134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a44ff-d78f-4925-bed2-a3b13e32103c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:02.996134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a44ff-d78f-4925-bed2-a3b13e32103c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:02.996134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a44ff-d78f-4925-bed2-a3b13e32103c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:02.996134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 501/995] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:02.998216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bc7e3-7272-4d9d-bbe2-97b438e41de1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:03.000988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13d1d-1e7f-42ef-82f9-5508c1d52a25 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:03.001317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13d1d-1e7f-42ef-82f9-5508c1d52a25 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:03.001591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13d1d-1e7f-42ef-82f9-5508c1d52a25 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:03.002815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 502/996] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:03.003941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2fe8-747a-4e8d-9fdb-e17b5afcd4db None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:03.004252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2fe8-747a-4e8d-9fdb-e17b5afcd4db None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:03.004528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a2fe8-747a-4e8d-9fdb-e17b5afcd4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:03.022772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-914a2fe8-747a-4e8d-9fdb-e17b5afcd4db None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:03.023883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-914a2fe8-747a-4e8d-9fdb-e17b5afcd4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:03.029970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:03.090097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 503/997] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:03.091284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfbbf4-e75f-4987-a95a-613f1789f8de None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:03.091634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfbbf4-e75f-4987-a95a-613f1789f8de None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:03.091970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfbbf4-e75f-4987-a95a-613f1789f8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:03.098599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bc7e3-7272-4d9d-bbe2-97b438e41de1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:03.119221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d2cfbbf4-e75f-4987-a95a-613f1789f8de None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:03.120531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d2cfbbf4-e75f-4987-a95a-613f1789f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:03.133075 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df87792-8a78-41c4-9a52-f856968ab184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:03.133272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df87792-8a78-41c4-9a52-f856968ab184 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:03.133443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df87792-8a78-41c4-9a52-f856968ab184 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:03.133717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df87792-8a78-41c4-9a52-f856968ab184 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:03.134424 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df87792-8a78-41c4-9a52-f856968ab184 None admin] RBAC: Adding query filter params (interface=public, service_id=f9465a66fe5e470cae70ab23b172af62, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:03.134731 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df87792-8a78-41c4-9a52-f856968ab184 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:03.136105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df87792-8a78-41c4-9a52-f856968ab184 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:03.147697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 495/998] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Sep 19 16:58:02 2022] GET /identity/v3/endpoints?service_id=f9465a66fe5e470cae70ab23b172af62&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:03.149018 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df87792-8a78-41c4-9a52-f856968ab184 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:03.212191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 504/999] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:03.255201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:03.263177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df87792-8a78-41c4-9a52-f856968ab184 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:03.297995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ea3e0-39bd-4a5c-9f1b-22f818e7d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:03.298562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ea3e0-39bd-4a5c-9f1b-22f818e7d8eb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:03.298839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ea3e0-39bd-4a5c-9f1b-22f818e7d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:03.299107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ea3e0-39bd-4a5c-9f1b-22f818e7d8eb None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:03.299712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ea3e0-39bd-4a5c-9f1b-22f818e7d8eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:03.301160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ea3e0-39bd-4a5c-9f1b-22f818e7d8eb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:03.307501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 496/1000] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Sep 19 16:58:03 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:58:03.356617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfbbf4-e75f-4987-a95a-613f1789f8de None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:03.369361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:03.471987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfbbf4-e75f-4987-a95a-613f1789f8de None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:03.480696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ea3e0-39bd-4a5c-9f1b-22f818e7d8eb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:03.509941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f76c7-01a0-491d-b3c4-ad269abd7b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:03.510394 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f76c7-01a0-491d-b3c4-ad269abd7b0d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:03.510701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f76c7-01a0-491d-b3c4-ad269abd7b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:03.510962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f76c7-01a0-491d-b3c4-ad269abd7b0d None admin] PATH_INFO: `/v3/services/image` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:03.511550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f76c7-01a0-491d-b3c4-ad269abd7b0d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:03.512931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f76c7-01a0-491d-b3c4-ad269abd7b0d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5a7f76c7-01a0-491d-b3c4-ad269abd7b0d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:03.522397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:03.523459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:03.524299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 505/1001] 10.222.0.76 () {56 vars in 1105 bytes} [Mon Sep 19 16:58:03 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:03.531041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f76c7-01a0-491d-b3c4-ad269abd7b0d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:03.610277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ea3e0-39bd-4a5c-9f1b-22f818e7d8eb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:03.616784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:03.648248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5bd79-e44a-49c1-b03a-b3de4028d4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:03.648889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5bd79-e44a-49c1-b03a-b3de4028d4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:03.649194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5bd79-e44a-49c1-b03a-b3de4028d4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:03.649462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5bd79-e44a-49c1-b03a-b3de4028d4d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:03.649562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f76c7-01a0-491d-b3c4-ad269abd7b0d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:03.650048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5bd79-e44a-49c1-b03a-b3de4028d4d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:03.651411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5bd79-e44a-49c1-b03a-b3de4028d4d4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-07b5bd79-e44a-49c1-b03a-b3de4028d4d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:03.660423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:03.665218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:03.666119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 497/1002] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Sep 19 16:58:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:58:03.667379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5bd79-e44a-49c1-b03a-b3de4028d4d4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:03.692918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93817c29-8cb7-43b6-973d-2ffa4ca3cc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:03.693448 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:03.693565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93817c29-8cb7-43b6-973d-2ffa4ca3cc66 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:03.693837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93817c29-8cb7-43b6-973d-2ffa4ca3cc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:03.694116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93817c29-8cb7-43b6-973d-2ffa4ca3cc66 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:03.695132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93817c29-8cb7-43b6-973d-2ffa4ca3cc66 None admin] RBAC: Adding query filter params (name=image) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:03.695132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93817c29-8cb7-43b6-973d-2ffa4ca3cc66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:03.696562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93817c29-8cb7-43b6-973d-2ffa4ca3cc66 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:03.701880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 506/1003] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:03.707687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93817c29-8cb7-43b6-973d-2ffa4ca3cc66 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:03.781170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5bd79-e44a-49c1-b03a-b3de4028d4d4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:03.815222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc7fe3-dac9-41a2-a754-b31048618b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:03.815841 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc7fe3-dac9-41a2-a754-b31048618b38 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:03.816138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc7fe3-dac9-41a2-a754-b31048618b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:03.816415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc7fe3-dac9-41a2-a754-b31048618b38 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:03.817069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc7fe3-dac9-41a2-a754-b31048618b38 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:03.817382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc7fe3-dac9-41a2-a754-b31048618b38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:03.818753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc7fe3-dac9-41a2-a754-b31048618b38 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:03.819886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93817c29-8cb7-43b6-973d-2ffa4ca3cc66 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:03.823824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 498/1004] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Sep 19 16:58:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:03.829464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc7fe3-dac9-41a2-a754-b31048618b38 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:03.855228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993c054-3ed4-4854-903d-e2cdaf6f0189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:03.855845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993c054-3ed4-4854-903d-e2cdaf6f0189 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:03.856130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993c054-3ed4-4854-903d-e2cdaf6f0189 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:03.856409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993c054-3ed4-4854-903d-e2cdaf6f0189 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:03.857072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993c054-3ed4-4854-903d-e2cdaf6f0189 None admin] RBAC: Adding query filter params (type=image) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:03.857385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993c054-3ed4-4854-903d-e2cdaf6f0189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:03.858754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993c054-3ed4-4854-903d-e2cdaf6f0189 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:03.860864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:03.864866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 507/1005] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:03.950337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:03.964812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc7fe3-dac9-41a2-a754-b31048618b38 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:04.003394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8687e-9f1c-4827-9537-41c006d784d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:04.004540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8687e-9f1c-4827-9537-41c006d784d2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:04.005017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8687e-9f1c-4827-9537-41c006d784d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:04.005573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8687e-9f1c-4827-9537-41c006d784d2 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:04.006477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8687e-9f1c-4827-9537-41c006d784d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:04.006969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8687e-9f1c-4827-9537-41c006d784d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:04.008568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8687e-9f1c-4827-9537-41c006d784d2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:04.014488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 499/1006] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Sep 19 16:58:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:04.020945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993c054-3ed4-4854-903d-e2cdaf6f0189 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:04.122108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993c054-3ed4-4854-903d-e2cdaf6f0189 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:04.157355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e184102-c74e-4810-813b-85d262c6d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:04.157985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e184102-c74e-4810-813b-85d262c6d5b3 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:04.158270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e184102-c74e-4810-813b-85d262c6d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:04.158544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e184102-c74e-4810-813b-85d262c6d5b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:04.159231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e184102-c74e-4810-813b-85d262c6d5b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:04.160719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e184102-c74e-4810-813b-85d262c6d5b3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:04.179904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 508/1007] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 16:58:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:58:05.498939 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d55e5-0ca7-4bd4-b9ae-65100d68785e None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:05.502638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d55e5-0ca7-4bd4-b9ae-65100d68785e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:05.502638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d55e5-0ca7-4bd4-b9ae-65100d68785e None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:05.502638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 500/1008] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:05.506767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8103c1-8955-4de0-8515-c5647bf9b3fa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:05.507171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8103c1-8955-4de0-8515-c5647bf9b3fa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:05.507335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8103c1-8955-4de0-8515-c5647bf9b3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:05.526507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7a8103c1-8955-4de0-8515-c5647bf9b3fa None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:05.527721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7a8103c1-8955-4de0-8515-c5647bf9b3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:05.588709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:05.608511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 509/1009] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:05.875370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d55e5-0ca7-4bd4-b9ae-65100d68785e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:05.992316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d55e5-0ca7-4bd4-b9ae-65100d68785e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:06.022239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e72acd-b5a9-41aa-a152-ccf91f152b52 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:06.022586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e72acd-b5a9-41aa-a152-ccf91f152b52 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:06.022797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e72acd-b5a9-41aa-a152-ccf91f152b52 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:06.025069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 510/1010] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:58:06.029155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1e0a-84af-4d7b-bb68-a256c15dba0e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:06.029436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1e0a-84af-4d7b-bb68-a256c15dba0e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:06.029710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1e0a-84af-4d7b-bb68-a256c15dba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:06.030617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5580-2fbf-4a9d-8a0a-e7dc661fd38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:06.031257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5580-2fbf-4a9d-8a0a-e7dc661fd38d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:06.031530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5580-2fbf-4a9d-8a0a-e7dc661fd38d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:06.031796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5580-2fbf-4a9d-8a0a-e7dc661fd38d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:06.032378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae5580-2fbf-4a9d-8a0a-e7dc661fd38d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:06.033805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae5580-2fbf-4a9d-8a0a-e7dc661fd38d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4cae5580-2fbf-4a9d-8a0a-e7dc661fd38d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:06.044423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:06.045564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:06.046575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 501/1011] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:58:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:06.053170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5580-2fbf-4a9d-8a0a-e7dc661fd38d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:06.053666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-03fa1e0a-84af-4d7b-bb68-a256c15dba0e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:06.055162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-03fa1e0a-84af-4d7b-bb68-a256c15dba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:06.074429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:06.144755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 511/1012] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:58:06.178878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5580-2fbf-4a9d-8a0a-e7dc661fd38d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:06.223370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aaf160-9616-42b3-8fd1-3893fd34f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:06.225667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaf160-9616-42b3-8fd1-3893fd34f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:06.225950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaf160-9616-42b3-8fd1-3893fd34f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:06.226220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaf160-9616-42b3-8fd1-3893fd34f5a0 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:06.226891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaf160-9616-42b3-8fd1-3893fd34f5a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:06.227189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaf160-9616-42b3-8fd1-3893fd34f5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:06.228602 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaf160-9616-42b3-8fd1-3893fd34f5a0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:06.240053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 502/1013] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:58:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:06.242216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1e0a-84af-4d7b-bb68-a256c15dba0e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:06.347901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1e0a-84af-4d7b-bb68-a256c15dba0e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:06.350354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea47a9-1568-4c17-ac75-241cd8576e60 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:06.350642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea47a9-1568-4c17-ac75-241cd8576e60 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:06.351725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea47a9-1568-4c17-ac75-241cd8576e60 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:06.353231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 503/1014] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:06.358180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64741d35-567a-45fe-9688-b6bb4e2c7299 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:06.358464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64741d35-567a-45fe-9688-b6bb4e2c7299 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:06.358759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64741d35-567a-45fe-9688-b6bb4e2c7299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:06.366172 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:06.378541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-64741d35-567a-45fe-9688-b6bb4e2c7299 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:06.380214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-64741d35-567a-45fe-9688-b6bb4e2c7299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:06.386327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4dad6-07c0-4c50-9b80-b8f9a2252c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:06.386946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4dad6-07c0-4c50-9b80-b8f9a2252c0d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:06.387273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4dad6-07c0-4c50-9b80-b8f9a2252c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:06.387492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4dad6-07c0-4c50-9b80-b8f9a2252c0d None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:06.388527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4dad6-07c0-4c50-9b80-b8f9a2252c0d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:06.388830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4dad6-07c0-4c50-9b80-b8f9a2252c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:06.390596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4dad6-07c0-4c50-9b80-b8f9a2252c0d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:06.396401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 512/1015] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Sep 19 16:58:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:06.402087 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4dad6-07c0-4c50-9b80-b8f9a2252c0d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:06.451547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 504/1016] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:06.452195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64741d35-567a-45fe-9688-b6bb4e2c7299 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:06.463299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:06.508669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4dad6-07c0-4c50-9b80-b8f9a2252c0d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:06.545049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fb2b5-dd6c-407d-beb5-2e25e3ede135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:06.545795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb2b5-dd6c-407d-beb5-2e25e3ede135 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:06.546093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb2b5-dd6c-407d-beb5-2e25e3ede135 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:06.546367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb2b5-dd6c-407d-beb5-2e25e3ede135 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:06.547035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fb2b5-dd6c-407d-beb5-2e25e3ede135 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:06.548522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fb2b5-dd6c-407d-beb5-2e25e3ede135 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:06.551622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64741d35-567a-45fe-9688-b6bb4e2c7299 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:06.571597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 513/1017] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 16:58:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:58:06.593440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876067d-62c3-465d-9d95-bd920be138f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:06.594076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876067d-62c3-465d-9d95-bd920be138f0 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:06.594351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876067d-62c3-465d-9d95-bd920be138f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:06.594637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876067d-62c3-465d-9d95-bd920be138f0 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:06.595279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876067d-62c3-465d-9d95-bd920be138f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:06.596691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876067d-62c3-465d-9d95-bd920be138f0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:06.616956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 505/1018] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:58:06 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:58:06.715116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fb2b5-dd6c-407d-beb5-2e25e3ede135 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:06.756969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:06.835115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fb2b5-dd6c-407d-beb5-2e25e3ede135 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:06.876900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33917a71-27ad-4c58-a6cb-4398c2b4c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:06.877589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33917a71-27ad-4c58-a6cb-4398c2b4c004 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:06.877864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33917a71-27ad-4c58-a6cb-4398c2b4c004 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:06.878132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33917a71-27ad-4c58-a6cb-4398c2b4c004 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:06.879282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33917a71-27ad-4c58-a6cb-4398c2b4c004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:06.880717 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33917a71-27ad-4c58-a6cb-4398c2b4c004 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:06.882304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 514/1019] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:06.888579 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876067d-62c3-465d-9d95-bd920be138f0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:06.955476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:06.993813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876067d-62c3-465d-9d95-bd920be138f0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:07.027562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0d6d3-3390-4bf4-a167-900a30034fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:07.028179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0d6d3-3390-4bf4-a167-900a30034fd0 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:07.028455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0d6d3-3390-4bf4-a167-900a30034fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:07.028719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0d6d3-3390-4bf4-a167-900a30034fd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:07.029388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0d6d3-3390-4bf4-a167-900a30034fd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:07.030815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0d6d3-3390-4bf4-a167-900a30034fd0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:07.065058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 506/1020] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:58:06 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:58:08.778908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d11f-f1e0-441d-951f-606e3db2d374 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:08.779474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d11f-f1e0-441d-951f-606e3db2d374 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:08.779474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d11f-f1e0-441d-951f-606e3db2d374 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:08.780830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 515/1021] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:08.786434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d430c-0732-4825-ada5-b43e9666db0d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:08.786888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d430c-0732-4825-ada5-b43e9666db0d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:08.786888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d430c-0732-4825-ada5-b43e9666db0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:08.805780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a82d430c-0732-4825-ada5-b43e9666db0d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:08.806957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a82d430c-0732-4825-ada5-b43e9666db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:08.808257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd778-e2b3-477d-912b-72ca451893bf None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:08.808510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd778-e2b3-477d-912b-72ca451893bf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:08.808778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cd778-e2b3-477d-912b-72ca451893bf None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:08.810147 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 516/1022] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:58:08.815054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0981ca-b428-4fd0-8732-5ae06a0f57ca None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:08.815305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0981ca-b428-4fd0-8732-5ae06a0f57ca None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:08.815606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0981ca-b428-4fd0-8732-5ae06a0f57ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:08.834533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-eb0981ca-b428-4fd0-8732-5ae06a0f57ca None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:08.835712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-eb0981ca-b428-4fd0-8732-5ae06a0f57ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:08.881995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 507/1023] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:08.909406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 517/1024] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:58:09.143407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d430c-0732-4825-ada5-b43e9666db0d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:09.187710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0981ca-b428-4fd0-8732-5ae06a0f57ca None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:09.199778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:09.220334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:09.256559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d430c-0732-4825-ada5-b43e9666db0d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:09.290230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f68be6-817d-42ec-85e9-789d8637e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:09.290861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f68be6-817d-42ec-85e9-789d8637e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.290959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0981ca-b428-4fd0-8732-5ae06a0f57ca None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:09.291136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f68be6-817d-42ec-85e9-789d8637e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.291399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f68be6-817d-42ec-85e9-789d8637e1f4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.291971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f68be6-817d-42ec-85e9-789d8637e1f4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:09.293385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f68be6-817d-42ec-85e9-789d8637e1f4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-34f68be6-817d-42ec-85e9-789d8637e1f4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:09.302319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:09.303512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:09.304630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 508/1025] 10.222.0.76 () {56 vars in 1105 bytes} [Mon Sep 19 16:58:09 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:09.305673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0c8f-2348-42b8-a85d-11f829cb7535 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.305673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0c8f-2348-42b8-a85d-11f829cb7535 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.305673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd0c8f-2348-42b8-a85d-11f829cb7535 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.306325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 509/1026] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:09.309860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd0c8f-2348-42b8-a85d-11f829cb7535 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:09.333432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95bc03-0808-4f98-8c0e-effffb99c7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:09.334064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bc03-0808-4f98-8c0e-effffb99c7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.334342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bc03-0808-4f98-8c0e-effffb99c7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.334614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bc03-0808-4f98-8c0e-effffb99c7f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.344472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95bc03-0808-4f98-8c0e-effffb99c7f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-aa95bc03-0808-4f98-8c0e-effffb99c7f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:58:09.349340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:09.350292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:09.351115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 518/1027] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Sep 19 16:58:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:09.351821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188c4cf-e436-4270-94a4-dd523e54d8a2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.352793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188c4cf-e436-4270-94a4-dd523e54d8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.352793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188c4cf-e436-4270-94a4-dd523e54d8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.370261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5188c4cf-e436-4270-94a4-dd523e54d8a2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:09.371472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5188c4cf-e436-4270-94a4-dd523e54d8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:09.414484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd0c8f-2348-42b8-a85d-11f829cb7535 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:09.426641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:09.437411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 519/1028] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:09.438421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188c4cf-e436-4270-94a4-dd523e54d8a2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:09.460012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:09.465176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1617de1-a192-4a20-bcee-1d9f84e9b225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:09.465887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1617de1-a192-4a20-bcee-1d9f84e9b225 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.466169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1617de1-a192-4a20-bcee-1d9f84e9b225 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.466440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1617de1-a192-4a20-bcee-1d9f84e9b225 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.467081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1617de1-a192-4a20-bcee-1d9f84e9b225 None admin] RBAC: Adding query filter params (name=image) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:09.467380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1617de1-a192-4a20-bcee-1d9f84e9b225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:09.468757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1617de1-a192-4a20-bcee-1d9f84e9b225 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:09.477806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 510/1029] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:09.479552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1617de1-a192-4a20-bcee-1d9f84e9b225 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:09.545834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188c4cf-e436-4270-94a4-dd523e54d8a2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:09.580917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229066b1-47f6-4ee3-8ff0-e4facae00edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:09.581553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229066b1-47f6-4ee3-8ff0-e4facae00edd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.581828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229066b1-47f6-4ee3-8ff0-e4facae00edd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.582160 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229066b1-47f6-4ee3-8ff0-e4facae00edd None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.582558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1617de1-a192-4a20-bcee-1d9f84e9b225 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:09.582819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229066b1-47f6-4ee3-8ff0-e4facae00edd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:09.583118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229066b1-47f6-4ee3-8ff0-e4facae00edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:09.584480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229066b1-47f6-4ee3-8ff0-e4facae00edd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:09.592718 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 520/1030] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Sep 19 16:58:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:09.598496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229066b1-47f6-4ee3-8ff0-e4facae00edd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:09.622035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73a68e-6ae9-4752-a1f9-06966ae27100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:09.622634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73a68e-6ae9-4752-a1f9-06966ae27100 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.622906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73a68e-6ae9-4752-a1f9-06966ae27100 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.623172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73a68e-6ae9-4752-a1f9-06966ae27100 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.623802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73a68e-6ae9-4752-a1f9-06966ae27100 None admin] RBAC: Adding query filter params (type=image) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:09.624098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73a68e-6ae9-4752-a1f9-06966ae27100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:09.625536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73a68e-6ae9-4752-a1f9-06966ae27100 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:09.630342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 511/1031] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:09.636074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73a68e-6ae9-4752-a1f9-06966ae27100 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:09.676665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:09.684927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:09.706347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229066b1-47f6-4ee3-8ff0-e4facae00edd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:09.735519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73a68e-6ae9-4752-a1f9-06966ae27100 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:09.739093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d247bd-fa5e-46b8-a784-149c3a70d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:09.739728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d247bd-fa5e-46b8-a784-149c3a70d52e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.740014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d247bd-fa5e-46b8-a784-149c3a70d52e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.740281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d247bd-fa5e-46b8-a784-149c3a70d52e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.750625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d247bd-fa5e-46b8-a784-149c3a70d52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:09.752072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d247bd-fa5e-46b8-a784-149c3a70d52e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-53d247bd-fa5e-46b8-a784-149c3a70d52e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:58:09.766332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:09.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:58:09.768331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:58:09.768331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:09.768331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:09.768331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 521/1032] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:58:09.768331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d247bd-fa5e-46b8-a784-149c3a70d52e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:09.772402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c4df7-30f4-4189-9351-5afa3424c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:09.773613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4df7-30f4-4189-9351-5afa3424c644 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.773903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4df7-30f4-4189-9351-5afa3424c644 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.774180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c4df7-30f4-4189-9351-5afa3424c644 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.774903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c4df7-30f4-4189-9351-5afa3424c644 None admin] RBAC: Adding query filter params (interface=public, service_id=0ee218644d714562885421d0064b7f52, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:09.775217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c4df7-30f4-4189-9351-5afa3424c644 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:09.776588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c4df7-30f4-4189-9351-5afa3424c644 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:09.781930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 512/1033] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Sep 19 16:58:09 2022] GET /identity/v3/endpoints?service_id=0ee218644d714562885421d0064b7f52&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:09.782619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c4df7-30f4-4189-9351-5afa3424c644 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:09.870625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d247bd-fa5e-46b8-a784-149c3a70d52e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:09.879790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c4df7-30f4-4189-9351-5afa3424c644 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:09.882354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:09.904305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2595f-5ab7-400b-88f4-49fec2a887d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:09.904933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2595f-5ab7-400b-88f4-49fec2a887d8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.905239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2595f-5ab7-400b-88f4-49fec2a887d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.905498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2595f-5ab7-400b-88f4-49fec2a887d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.906634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2595f-5ab7-400b-88f4-49fec2a887d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:09.908058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2595f-5ab7-400b-88f4-49fec2a887d8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:09.909972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 522/1034] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:09.910664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2595f-5ab7-400b-88f4-49fec2a887d8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:09.913189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:09.914640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e94c9-c336-48c3-928e-b09a9b548ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:09.915268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e94c9-c336-48c3-928e-b09a9b548ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:09.915542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e94c9-c336-48c3-928e-b09a9b548ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:09.915807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e94c9-c336-48c3-928e-b09a9b548ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:09.916433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e94c9-c336-48c3-928e-b09a9b548ec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:09.916756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e94c9-c336-48c3-928e-b09a9b548ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:09.918123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e94c9-c336-48c3-928e-b09a9b548ec3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:09.930313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 513/1035] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:09.931023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e94c9-c336-48c3-928e-b09a9b548ec3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:10.012557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2595f-5ab7-400b-88f4-49fec2a887d8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:10.027900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e94c9-c336-48c3-928e-b09a9b548ec3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:10.045054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d338d-7a70-4071-a915-694d4701a221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:10.045662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d338d-7a70-4071-a915-694d4701a221 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:10.045943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d338d-7a70-4071-a915-694d4701a221 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:10.046218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d338d-7a70-4071-a915-694d4701a221 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:10.046819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d338d-7a70-4071-a915-694d4701a221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:10.048219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d338d-7a70-4071-a915-694d4701a221 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:10.056703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 523/1036] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Sep 19 16:58:09 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 16:58:10.057521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d338d-7a70-4071-a915-694d4701a221 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:10.062069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d8e87-8072-47dc-ae8f-2a057f18b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:10.062698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8e87-8072-47dc-ae8f-2a057f18b019 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:10.062978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8e87-8072-47dc-ae8f-2a057f18b019 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:10.063247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8e87-8072-47dc-ae8f-2a057f18b019 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:10.063917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d8e87-8072-47dc-ae8f-2a057f18b019 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:10.065430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d8e87-8072-47dc-ae8f-2a057f18b019 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:10.089843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 514/1037] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:58:09 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:58:10.152875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:10.194786 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d338d-7a70-4071-a915-694d4701a221 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:10.235993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53f09-46aa-4e82-acf7-41618996f915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:10.236674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53f09-46aa-4e82-acf7-41618996f915 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:10.236958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53f09-46aa-4e82-acf7-41618996f915 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:10.237259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53f09-46aa-4e82-acf7-41618996f915 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:10.247143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53f09-46aa-4e82-acf7-41618996f915 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:10.248656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53f09-46aa-4e82-acf7-41618996f915 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-cbb53f09-46aa-4e82-acf7-41618996f915 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:58:10.261388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:10.262610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:10.263728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 524/1038] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Sep 19 16:58:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:10.269550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d8e87-8072-47dc-ae8f-2a057f18b019 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:10.293913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:10.375522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d8e87-8072-47dc-ae8f-2a057f18b019 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:10.410445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c4c9a-1f9b-4a38-8fce-3d0e09bc69b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:10.411066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4c9a-1f9b-4a38-8fce-3d0e09bc69b2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:10.411349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4c9a-1f9b-4a38-8fce-3d0e09bc69b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:10.411622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c4c9a-1f9b-4a38-8fce-3d0e09bc69b2 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:10.412377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c4c9a-1f9b-4a38-8fce-3d0e09bc69b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:10.412674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c4c9a-1f9b-4a38-8fce-3d0e09bc69b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:10.414198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c4c9a-1f9b-4a38-8fce-3d0e09bc69b2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:10.432214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 515/1039] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Sep 19 16:58:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:10.437996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53f09-46aa-4e82-acf7-41618996f915 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:10.539889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53f09-46aa-4e82-acf7-41618996f915 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:10.567221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:10.578153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559114a-4a25-499c-a4de-0ac1dd2fb75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:10.578786 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559114a-4a25-499c-a4de-0ac1dd2fb75f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:10.579038 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559114a-4a25-499c-a4de-0ac1dd2fb75f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:10.579325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559114a-4a25-499c-a4de-0ac1dd2fb75f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:10.646460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559114a-4a25-499c-a4de-0ac1dd2fb75f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:10.647923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559114a-4a25-499c-a4de-0ac1dd2fb75f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:10.745082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 525/1040] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:58:10 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 16:58:10.751243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c4c9a-1f9b-4a38-8fce-3d0e09bc69b2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:10.833567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:10.857596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c4c9a-1f9b-4a38-8fce-3d0e09bc69b2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:10.893194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc7958-5030-463e-9f6f-e9000d0b8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:10.894213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc7958-5030-463e-9f6f-e9000d0b8edf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:10.894477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc7958-5030-463e-9f6f-e9000d0b8edf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:10.894720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc7958-5030-463e-9f6f-e9000d0b8edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:10.905387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc7958-5030-463e-9f6f-e9000d0b8edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:10.906871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc7958-5030-463e-9f6f-e9000d0b8edf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f7dc7958-5030-463e-9f6f-e9000d0b8edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:58:10.922614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:10.923594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:58:10.929896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:58:10.929896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:10.929896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:10.929896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 516/1041] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:10.930135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559114a-4a25-499c-a4de-0ac1dd2fb75f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:10.959605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:11.035204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559114a-4a25-499c-a4de-0ac1dd2fb75f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:11.071382 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641e198-c1fe-4fe4-ad70-32ed54ac1884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:11.071997 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641e198-c1fe-4fe4-ad70-32ed54ac1884 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:11.072278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641e198-c1fe-4fe4-ad70-32ed54ac1884 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:11.072548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641e198-c1fe-4fe4-ad70-32ed54ac1884 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:11.073219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641e198-c1fe-4fe4-ad70-32ed54ac1884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:11.073522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641e198-c1fe-4fe4-ad70-32ed54ac1884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:11.074907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641e198-c1fe-4fe4-ad70-32ed54ac1884 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:11.089461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 526/1042] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:11.092330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc7958-5030-463e-9f6f-e9000d0b8edf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:11.194858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc7958-5030-463e-9f6f-e9000d0b8edf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:11.223471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:11.231035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb2f14-8e1a-42de-95de-1045080ed84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:11.231675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2f14-8e1a-42de-95de-1045080ed84a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:11.231955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2f14-8e1a-42de-95de-1045080ed84a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:11.232230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2f14-8e1a-42de-95de-1045080ed84a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:11.239475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb2f14-8e1a-42de-95de-1045080ed84a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:11.240932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb2f14-8e1a-42de-95de-1045080ed84a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-23eb2f14-8e1a-42de-95de-1045080ed84a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:58:11.252721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:11.253861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:11.259697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:58:11.259697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:58:11.259697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:58:11.259697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:58:11.259697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:58:11.259697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:58:11.259697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:58:11.259697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:11.259697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 517/1043] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:58:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:11.260214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641e198-c1fe-4fe4-ad70-32ed54ac1884 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:11.350385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:11.366724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641e198-c1fe-4fe4-ad70-32ed54ac1884 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:11.400577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f29d4a-8e0a-4ee2-891c-9ae80b7d4c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:11.401225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f29d4a-8e0a-4ee2-891c-9ae80b7d4c16 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:11.401511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f29d4a-8e0a-4ee2-891c-9ae80b7d4c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:11.401823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f29d4a-8e0a-4ee2-891c-9ae80b7d4c16 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:11.402529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f29d4a-8e0a-4ee2-891c-9ae80b7d4c16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:11.402898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f29d4a-8e0a-4ee2-891c-9ae80b7d4c16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:11.404333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f29d4a-8e0a-4ee2-891c-9ae80b7d4c16 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:11.421064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 527/1044] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:58:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:11.423121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb2f14-8e1a-42de-95de-1045080ed84a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:11.524878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb2f14-8e1a-42de-95de-1045080ed84a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:11.558417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dc230-ff08-4403-9b96-5ddaa241bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:11.559022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dc230-ff08-4403-9b96-5ddaa241bcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:11.559298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dc230-ff08-4403-9b96-5ddaa241bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:11.559570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dc230-ff08-4403-9b96-5ddaa241bcc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:11.560302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dc230-ff08-4403-9b96-5ddaa241bcc0 None admin] RBAC: Adding query filter params (role.id=df4a78a83b4846d5b311f4b9f038b434, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=ea18c782ddf2469fa3d10a135fc34c37) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:11.560647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dc230-ff08-4403-9b96-5ddaa241bcc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:11.562305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dc230-ff08-4403-9b96-5ddaa241bcc0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:11.567910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 518/1045] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:58:11 2022] GET /identity/v3/role_assignments?user.id=ea18c782ddf2469fa3d10a135fc34c37&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=df4a78a83b4846d5b311f4b9f038b434 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:12.187555 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff86cac-9199-488e-99f0-6935665a3c6f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:12.188075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff86cac-9199-488e-99f0-6935665a3c6f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:12.188152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff86cac-9199-488e-99f0-6935665a3c6f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:12.189573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 528/1046] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:12.195197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fc110-237f-459b-9208-0d1c0edaa3c2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:12.195744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fc110-237f-459b-9208-0d1c0edaa3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:12.195744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fc110-237f-459b-9208-0d1c0edaa3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:12.215378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-478fc110-237f-459b-9208-0d1c0edaa3c2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:12.216622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-478fc110-237f-459b-9208-0d1c0edaa3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:12.269728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:12.289077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 519/1047] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:12.322445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181e6f-7509-471f-bf04-caec1764e05c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:12.322786 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181e6f-7509-471f-bf04-caec1764e05c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:12.322988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181e6f-7509-471f-bf04-caec1764e05c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:12.324522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 529/1048] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:12.329737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5c2e-34e5-4619-b405-48dec6c6c659 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:12.330000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5c2e-34e5-4619-b405-48dec6c6c659 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:12.330300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5c2e-34e5-4619-b405-48dec6c6c659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:12.349354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d55d5c2e-34e5-4619-b405-48dec6c6c659 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:12.350558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d55d5c2e-34e5-4619-b405-48dec6c6c659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:12.421205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 520/1049] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:12.567461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181e6f-7509-471f-bf04-caec1764e05c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:12.673163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181e6f-7509-471f-bf04-caec1764e05c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:12.686148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5c2e-34e5-4619-b405-48dec6c6c659 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:12.711299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b7eb0-00b9-41a7-b8e7-6f9a84b10dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:12.711936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b7eb0-00b9-41a7-b8e7-6f9a84b10dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:12.712213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b7eb0-00b9-41a7-b8e7-6f9a84b10dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:12.712480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b7eb0-00b9-41a7-b8e7-6f9a84b10dc4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:12.713123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b7eb0-00b9-41a7-b8e7-6f9a84b10dc4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:12.714477 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b7eb0-00b9-41a7-b8e7-6f9a84b10dc4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ab3b7eb0-00b9-41a7-b8e7-6f9a84b10dc4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:12.723459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:12.724491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:12.725373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 530/1050] 10.222.0.76 () {56 vars in 1105 bytes} [Mon Sep 19 16:58:12 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:12.730379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b7eb0-00b9-41a7-b8e7-6f9a84b10dc4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:12.743108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:12.816560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5c2e-34e5-4619-b405-48dec6c6c659 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:12.831206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:12.835543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b7eb0-00b9-41a7-b8e7-6f9a84b10dc4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:12.852903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c4073-d77a-4ac5-b30d-88f8c46ba346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:12.853571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c4073-d77a-4ac5-b30d-88f8c46ba346 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:12.853847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c4073-d77a-4ac5-b30d-88f8c46ba346 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:12.854121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c4073-d77a-4ac5-b30d-88f8c46ba346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:12.864137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c4073-d77a-4ac5-b30d-88f8c46ba346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e96c4073-d77a-4ac5-b30d-88f8c46ba346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:58:12.868861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:12.870020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:12.871022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 521/1051] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:58:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:12.876112 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c4073-d77a-4ac5-b30d-88f8c46ba346 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:12.876639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e9a2b-706f-4e63-b4cc-831aa770cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:12.877296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e9a2b-706f-4e63-b4cc-831aa770cee0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:12.877582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e9a2b-706f-4e63-b4cc-831aa770cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:12.877859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e9a2b-706f-4e63-b4cc-831aa770cee0 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:12.878498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e9a2b-706f-4e63-b4cc-831aa770cee0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:12.878862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e9a2b-706f-4e63-b4cc-831aa770cee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:12.880926 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e9a2b-706f-4e63-b4cc-831aa770cee0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:12.885494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 531/1052] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:12.890959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e9a2b-706f-4e63-b4cc-831aa770cee0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:12.967055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:12.982000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c4073-d77a-4ac5-b30d-88f8c46ba346 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:12.992550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e9a2b-706f-4e63-b4cc-831aa770cee0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:13.021216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24b255-a542-4dba-a24b-5afd2defefd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:13.021845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24b255-a542-4dba-a24b-5afd2defefd4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:13.022126 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24b255-a542-4dba-a24b-5afd2defefd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:13.022401 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24b255-a542-4dba-a24b-5afd2defefd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:13.023074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24b255-a542-4dba-a24b-5afd2defefd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:13.023378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24b255-a542-4dba-a24b-5afd2defefd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:13.024755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24b255-a542-4dba-a24b-5afd2defefd4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:13.028593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89662127-7162-45aa-92df-858dea33a443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:13.029450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89662127-7162-45aa-92df-858dea33a443 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:13.030333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89662127-7162-45aa-92df-858dea33a443 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:13.030787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89662127-7162-45aa-92df-858dea33a443 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:13.031875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89662127-7162-45aa-92df-858dea33a443 None admin] RBAC: Adding query filter params (type=image) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:13.032354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89662127-7162-45aa-92df-858dea33a443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:13.033021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 522/1053] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:58:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:13.034066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89662127-7162-45aa-92df-858dea33a443 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:13.038830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24b255-a542-4dba-a24b-5afd2defefd4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:13.045327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 532/1054] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:13.046738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89662127-7162-45aa-92df-858dea33a443 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:13.074744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:13.148351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24b255-a542-4dba-a24b-5afd2defefd4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:13.153402 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89662127-7162-45aa-92df-858dea33a443 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:13.188420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded53d5-484f-46ed-93c4-692fbfd37549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:13.189171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded53d5-484f-46ed-93c4-692fbfd37549 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:13.189486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded53d5-484f-46ed-93c4-692fbfd37549 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:13.189776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56978ba-16c9-44c1-8cc8-1c2d5fb159f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:13.189886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded53d5-484f-46ed-93c4-692fbfd37549 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:13.190414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56978ba-16c9-44c1-8cc8-1c2d5fb159f7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:13.190639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded53d5-484f-46ed-93c4-692fbfd37549 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:13.190730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56978ba-16c9-44c1-8cc8-1c2d5fb159f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:13.190958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56978ba-16c9-44c1-8cc8-1c2d5fb159f7 None admin] PATH_INFO: `/v3/users/d905b2b62dfd430686de422a84aba057` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:13.192234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded53d5-484f-46ed-93c4-692fbfd37549 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:13.200829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:13.206398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56978ba-16c9-44c1-8cc8-1c2d5fb159f7 None admin] RBAC: Authorizing `identity:get_user(user_id=d905b2b62dfd430686de422a84aba057)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:13.208004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56978ba-16c9-44c1-8cc8-1c2d5fb159f7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:13.209938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 523/1055] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:13 2022] GET /identity/v3/users/d905b2b62dfd430686de422a84aba057 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:13.215842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56978ba-16c9-44c1-8cc8-1c2d5fb159f7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:13.220418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 533/1056] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 16:58:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 16:58:13.323176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:13.331999 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56978ba-16c9-44c1-8cc8-1c2d5fb159f7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:13.375522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8a32c-10d5-4b34-81a5-4950e4925a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:13.376150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a32c-10d5-4b34-81a5-4950e4925a38 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:13.376422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a32c-10d5-4b34-81a5-4950e4925a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:13.376688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a32c-10d5-4b34-81a5-4950e4925a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:13.449138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8a32c-10d5-4b34-81a5-4950e4925a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:13.450621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8a32c-10d5-4b34-81a5-4950e4925a38 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:13.539021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:13.555273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 524/1057] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:58:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 16:58:13.556850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded53d5-484f-46ed-93c4-692fbfd37549 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:13.671197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded53d5-484f-46ed-93c4-692fbfd37549 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:13.705855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb5e58-27f4-4e48-8e21-452bb930a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:13.706493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb5e58-27f4-4e48-8e21-452bb930a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:13.706773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb5e58-27f4-4e48-8e21-452bb930a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:13.707074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb5e58-27f4-4e48-8e21-452bb930a6a1 None admin] PATH_INFO: `/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:13.708213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb5e58-27f4-4e48-8e21-452bb930a6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=5fedbc34e20145a8ae8dbedd92d0d0eb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:13.709697 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb5e58-27f4-4e48-8e21-452bb930a6a1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:13.711539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 534/1058] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:58:13 2022] GET /identity/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:13.717567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8a32c-10d5-4b34-81a5-4950e4925a38 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:13.741590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780d9a-e284-4f06-b80a-238289a56a73 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:13.741902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780d9a-e284-4f06-b80a-238289a56a73 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:13.742135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780d9a-e284-4f06-b80a-238289a56a73 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:13.743489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 535/1059] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:58:13.748197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b08d3-99d1-478b-ae5f-483d71757d8e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:13.748479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b08d3-99d1-478b-ae5f-483d71757d8e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:13.748753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b08d3-99d1-478b-ae5f-483d71757d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:13.767175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ad4b08d3-99d1-478b-ae5f-483d71757d8e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:13.768379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ad4b08d3-99d1-478b-ae5f-483d71757d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:13.831720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8a32c-10d5-4b34-81a5-4950e4925a38 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:13.834775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:13.847857 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 536/1060] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:58:13.871025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddaca60-0fcf-48ca-bb0b-82d7571515ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:13.871637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddaca60-0fcf-48ca-bb0b-82d7571515ed None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:13.871917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddaca60-0fcf-48ca-bb0b-82d7571515ed None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:13.872196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddaca60-0fcf-48ca-bb0b-82d7571515ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:13.872927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddaca60-0fcf-48ca-bb0b-82d7571515ed None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=5fedbc34e20145a8ae8dbedd92d0d0eb, user.id=d905b2b62dfd430686de422a84aba057) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:13.873377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddaca60-0fcf-48ca-bb0b-82d7571515ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:13.874846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddaca60-0fcf-48ca-bb0b-82d7571515ed None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:13.880810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 525/1061] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:58:13 2022] GET /identity/v3/role_assignments?user.id=d905b2b62dfd430686de422a84aba057&scope.project.id=5fedbc34e20145a8ae8dbedd92d0d0eb&role.id=77285ef607e34662b6234656fe8043d0 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:14.130816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b08d3-99d1-478b-ae5f-483d71757d8e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:14.239164 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b08d3-99d1-478b-ae5f-483d71757d8e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:14.275250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8747-5c7f-480e-a45a-290ca2dbb82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:14.275958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8747-5c7f-480e-a45a-290ca2dbb82f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:14.276245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8747-5c7f-480e-a45a-290ca2dbb82f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:14.276519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8747-5c7f-480e-a45a-290ca2dbb82f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:14.286782 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc8747-5c7f-480e-a45a-290ca2dbb82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8bdc8747-5c7f-480e-a45a-290ca2dbb82f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:58:14.291570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:14.292501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:58:14.293366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:14.297136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 537/1062] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Sep 19 16:58:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:14.299185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddaca60-0fcf-48ca-bb0b-82d7571515ed None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:14.358998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:14.409873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddaca60-0fcf-48ca-bb0b-82d7571515ed None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:14.443674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959838f-fa5d-43ad-bd20-da6004ae4c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:14.444295 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959838f-fa5d-43ad-bd20-da6004ae4c4c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:14.444576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959838f-fa5d-43ad-bd20-da6004ae4c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:14.444845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959838f-fa5d-43ad-bd20-da6004ae4c4c None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:14.445542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959838f-fa5d-43ad-bd20-da6004ae4c4c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:14.445843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959838f-fa5d-43ad-bd20-da6004ae4c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:14.447224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959838f-fa5d-43ad-bd20-da6004ae4c4c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:14.455937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 526/1063] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Sep 19 16:58:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:14.461835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8747-5c7f-480e-a45a-290ca2dbb82f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:14.516228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:14.565168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8747-5c7f-480e-a45a-290ca2dbb82f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:14.599736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add7866-1ff8-468d-bed2-094f487022e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:14.600381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add7866-1ff8-468d-bed2-094f487022e7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:14.600662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add7866-1ff8-468d-bed2-094f487022e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:14.600942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add7866-1ff8-468d-bed2-094f487022e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:14.611215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add7866-1ff8-468d-bed2-094f487022e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:14.612676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add7866-1ff8-468d-bed2-094f487022e7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-2add7866-1ff8-468d-bed2-094f487022e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:58:14.627364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:14.628296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:58:14.629336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:58:14.629336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:14.629336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:14.633422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 538/1064] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:14.634665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959838f-fa5d-43ad-bd20-da6004ae4c4c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:14.737292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959838f-fa5d-43ad-bd20-da6004ae4c4c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:14.756023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:14.775459 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c9cda-af5c-40b6-846d-9faab36c327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:14.776379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9cda-af5c-40b6-846d-9faab36c327e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:14.776836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9cda-af5c-40b6-846d-9faab36c327e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:14.777317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9cda-af5c-40b6-846d-9faab36c327e None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:14.778242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c9cda-af5c-40b6-846d-9faab36c327e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:14.778720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c9cda-af5c-40b6-846d-9faab36c327e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:14.780265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c9cda-af5c-40b6-846d-9faab36c327e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:14.796363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 527/1065] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:14.798032 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add7866-1ff8-468d-bed2-094f487022e7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:14.901762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add7866-1ff8-468d-bed2-094f487022e7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:14.904081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:14.935937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b49d10-11ca-406a-8611-511cc2931946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:14.936650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49d10-11ca-406a-8611-511cc2931946 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:14.936934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49d10-11ca-406a-8611-511cc2931946 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:14.937239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b49d10-11ca-406a-8611-511cc2931946 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:14.944794 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b49d10-11ca-406a-8611-511cc2931946 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:14.946275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b49d10-11ca-406a-8611-511cc2931946 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-24b49d10-11ca-406a-8611-511cc2931946 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:58:14.957259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:14.958270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:14.964448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 539/1066] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Sep 19 16:58:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:14.966802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c9cda-af5c-40b6-846d-9faab36c327e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:15.069231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c9cda-af5c-40b6-846d-9faab36c327e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:15.103923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1eb17-f12b-4f2b-8b4a-92efe85dbf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:15.104526 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1eb17-f12b-4f2b-8b4a-92efe85dbf6e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:15.104764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1eb17-f12b-4f2b-8b4a-92efe85dbf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:15.105071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1eb17-f12b-4f2b-8b4a-92efe85dbf6e None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:15.105803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1eb17-f12b-4f2b-8b4a-92efe85dbf6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:15.106096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1eb17-f12b-4f2b-8b4a-92efe85dbf6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:15.107557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1eb17-f12b-4f2b-8b4a-92efe85dbf6e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:15.125497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 528/1067] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Sep 19 16:58:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:15.131410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b49d10-11ca-406a-8611-511cc2931946 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:15.233922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b49d10-11ca-406a-8611-511cc2931946 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:15.266653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a71dd-f105-4155-b942-6ae97319fcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:15.267274 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a71dd-f105-4155-b942-6ae97319fcec None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:15.267542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a71dd-f105-4155-b942-6ae97319fcec None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:15.267809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a71dd-f105-4155-b942-6ae97319fcec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:15.278932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a71dd-f105-4155-b942-6ae97319fcec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:15.280381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a71dd-f105-4155-b942-6ae97319fcec None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-020a71dd-f105-4155-b942-6ae97319fcec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:58:15.295847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:15.296890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:58:15.297836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:58:15.297836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:15.297836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:15.301535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 540/1068] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:15.303288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1eb17-f12b-4f2b-8b4a-92efe85dbf6e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:15.340905 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:15.409073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1eb17-f12b-4f2b-8b4a-92efe85dbf6e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:15.410830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf97c-207b-46de-afda-340ba478a51d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:15.411145 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf97c-207b-46de-afda-340ba478a51d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:15.411426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cf97c-207b-46de-afda-340ba478a51d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:15.412821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 541/1069] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:15.418203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066916b-48eb-4c81-b8e3-5086355b14c0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:15.418564 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066916b-48eb-4c81-b8e3-5086355b14c0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:15.418914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066916b-48eb-4c81-b8e3-5086355b14c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:15.445988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6066916b-48eb-4c81-b8e3-5086355b14c0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:15.447985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6066916b-48eb-4c81-b8e3-5086355b14c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:15.455946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897efe-6646-4b1b-9549-658bcc9fba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:15.456572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897efe-6646-4b1b-9549-658bcc9fba7e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:15.456928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897efe-6646-4b1b-9549-658bcc9fba7e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:15.457230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897efe-6646-4b1b-9549-658bcc9fba7e None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:15.457992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897efe-6646-4b1b-9549-658bcc9fba7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:15.458289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897efe-6646-4b1b-9549-658bcc9fba7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:15.459662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897efe-6646-4b1b-9549-658bcc9fba7e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:15.461821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:15.476762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 529/1070] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:15.478885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897efe-6646-4b1b-9549-658bcc9fba7e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:15.527903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 542/1071] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:58:15.573443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:15.580786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897efe-6646-4b1b-9549-658bcc9fba7e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:15.616099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527eb8c3-c61c-432c-af90-30fcda636887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:15.616636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eb8c3-c61c-432c-af90-30fcda636887 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:15.616911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eb8c3-c61c-432c-af90-30fcda636887 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:15.617207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eb8c3-c61c-432c-af90-30fcda636887 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:15.624169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527eb8c3-c61c-432c-af90-30fcda636887 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:15.625645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527eb8c3-c61c-432c-af90-30fcda636887 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-527eb8c3-c61c-432c-af90-30fcda636887 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:58:15.637267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:15.638162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:15.644289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:58:15.644289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:58:15.644289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:58:15.644289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:58:15.644289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:58:15.644289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:58:15.644289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:58:15.644289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:15.644289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 530/1072] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:58:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:15.646790 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066916b-48eb-4c81-b8e3-5086355b14c0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:15.749894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066916b-48eb-4c81-b8e3-5086355b14c0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:15.786994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cb770-f015-4b5d-b5eb-bd5c9db36ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:15.787616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cb770-f015-4b5d-b5eb-bd5c9db36ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:15.787895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cb770-f015-4b5d-b5eb-bd5c9db36ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:15.788166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cb770-f015-4b5d-b5eb-bd5c9db36ad2 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:15.788862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cb770-f015-4b5d-b5eb-bd5c9db36ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:15.789203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cb770-f015-4b5d-b5eb-bd5c9db36ad2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:15.791117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cb770-f015-4b5d-b5eb-bd5c9db36ad2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:15.802041 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527eb8c3-c61c-432c-af90-30fcda636887 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:15.806884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 543/1073] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:15.813053 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cb770-f015-4b5d-b5eb-bd5c9db36ad2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:15.825602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:15.913775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527eb8c3-c61c-432c-af90-30fcda636887 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:15.930123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cb770-f015-4b5d-b5eb-bd5c9db36ad2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:15.947826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5b022-e501-4502-bcd1-f550d861366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:15.948439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5b022-e501-4502-bcd1-f550d861366b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:15.948716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5b022-e501-4502-bcd1-f550d861366b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:15.948986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5b022-e501-4502-bcd1-f550d861366b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:15.971259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926cf2b-8323-4b05-9d39-d93746c08032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:15.971943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926cf2b-8323-4b05-9d39-d93746c08032 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:15.972570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926cf2b-8323-4b05-9d39-d93746c08032 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:15.972846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926cf2b-8323-4b05-9d39-d93746c08032 None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/ea18c782ddf2469fa3d10a135fc34c37/roles/df4a78a83b4846d5b311f4b9f038b434` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:15.973838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:15.975390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926cf2b-8323-4b05-9d39-d93746c08032 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=ea18c782ddf2469fa3d10a135fc34c37, role_id=df4a78a83b4846d5b311f4b9f038b434)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:15.977123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926cf2b-8323-4b05-9d39-d93746c08032 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:15.993142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 544/1074] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:58:15 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/ea18c782ddf2469fa3d10a135fc34c37/roles/df4a78a83b4846d5b311f4b9f038b434 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 16:58:15.994929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09470-56e9-4e9f-9ce6-62aeec5e1f50 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:15.995226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09470-56e9-4e9f-9ce6-62aeec5e1f50 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:15.995496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09470-56e9-4e9f-9ce6-62aeec5e1f50 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:15.996895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 545/1075] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:16.003235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f5575-4624-4ed8-9667-db85035ecd1a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:16.003518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f5575-4624-4ed8-9667-db85035ecd1a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:16.003957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f5575-4624-4ed8-9667-db85035ecd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:16.024087 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-668f5575-4624-4ed8-9667-db85035ecd1a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:16.026001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-668f5575-4624-4ed8-9667-db85035ecd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:16.027316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5b022-e501-4502-bcd1-f550d861366b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:16.028810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5b022-e501-4502-bcd1-f550d861366b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:16.095357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:16.106903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 546/1076] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:58:16.157150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 531/1077] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:58:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:58:16.157726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f5575-4624-4ed8-9667-db85035ecd1a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:16.263033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f5575-4624-4ed8-9667-db85035ecd1a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:16.298404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e642d8-a70c-44ac-b716-16244a3da282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:16.299059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e642d8-a70c-44ac-b716-16244a3da282 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:16.299291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e642d8-a70c-44ac-b716-16244a3da282 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:16.299590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e642d8-a70c-44ac-b716-16244a3da282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:16.309678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e642d8-a70c-44ac-b716-16244a3da282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:16.311125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e642d8-a70c-44ac-b716-16244a3da282 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-60e642d8-a70c-44ac-b716-16244a3da282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:58:16.326041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:16.327021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:58:16.327920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:58:16.327920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:16.327920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:16.327920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 547/1078] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:58:16.334721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5b022-e501-4502-bcd1-f550d861366b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:16.370890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e642d8-a70c-44ac-b716-16244a3da282 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:16.391394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:16.424090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:16.437840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5b022-e501-4502-bcd1-f550d861366b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:16.475024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8c300-d037-47bc-b3d5-95bee7450f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:16.475917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8c300-d037-47bc-b3d5-95bee7450f1e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:16.476194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8c300-d037-47bc-b3d5-95bee7450f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:16.476472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8c300-d037-47bc-b3d5-95bee7450f1e None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:16.477155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8c300-d037-47bc-b3d5-95bee7450f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:16.477460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8c300-d037-47bc-b3d5-95bee7450f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:16.478838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8c300-d037-47bc-b3d5-95bee7450f1e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:16.480993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e642d8-a70c-44ac-b716-16244a3da282 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:16.490746 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 532/1079] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:16.521115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3f78e-0668-4f53-a890-9c048aa9cd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:16.521759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f78e-0668-4f53-a890-9c048aa9cd8d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:16.522037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f78e-0668-4f53-a890-9c048aa9cd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:16.522321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3f78e-0668-4f53-a890-9c048aa9cd8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:16.534523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3f78e-0668-4f53-a890-9c048aa9cd8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c6a3f78e-0668-4f53-a890-9c048aa9cd8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:58:16.539509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:16.540464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:16.541747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:16.545463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 548/1080] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:58:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:58:16.546948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8c300-d037-47bc-b3d5-95bee7450f1e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:16.658544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8c300-d037-47bc-b3d5-95bee7450f1e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:16.674165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:16.696023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a5163-ffd6-4753-8f71-8891222b518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:16.696910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a5163-ffd6-4753-8f71-8891222b518b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:16.697361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a5163-ffd6-4753-8f71-8891222b518b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:16.697779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a5163-ffd6-4753-8f71-8891222b518b None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:16.698617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a5163-ffd6-4753-8f71-8891222b518b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:16.699073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a5163-ffd6-4753-8f71-8891222b518b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:16.700452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a5163-ffd6-4753-8f71-8891222b518b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:16.709590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 533/1081] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:58:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:16.715543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3f78e-0668-4f53-a890-9c048aa9cd8d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:16.822255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3f78e-0668-4f53-a890-9c048aa9cd8d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:16.831605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:16.856483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22adf46-5b07-4730-adfc-a2d64f23f8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:16.857155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22adf46-5b07-4730-adfc-a2d64f23f8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:16.857438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22adf46-5b07-4730-adfc-a2d64f23f8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:16.857712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22adf46-5b07-4730-adfc-a2d64f23f8f8 None admin] PATH_INFO: `/v3/users/d905b2b62dfd430686de422a84aba057` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:16.858834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22adf46-5b07-4730-adfc-a2d64f23f8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=d905b2b62dfd430686de422a84aba057)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:16.860273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22adf46-5b07-4730-adfc-a2d64f23f8f8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:16.861892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 549/1082] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:16 2022] GET /identity/v3/users/d905b2b62dfd430686de422a84aba057 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:16.867765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a5163-ffd6-4753-8f71-8891222b518b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:16.973048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a5163-ffd6-4753-8f71-8891222b518b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:17.007547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea7de8-ec72-4eff-b7db-3327955be99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:17.008170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea7de8-ec72-4eff-b7db-3327955be99c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:17.008448 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea7de8-ec72-4eff-b7db-3327955be99c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:17.008702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea7de8-ec72-4eff-b7db-3327955be99c None admin] PATH_INFO: `/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:17.009862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea7de8-ec72-4eff-b7db-3327955be99c None admin] RBAC: Authorizing `identity:get_project(project_id=5fedbc34e20145a8ae8dbedd92d0d0eb)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:17.011295 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea7de8-ec72-4eff-b7db-3327955be99c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:17.012952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 534/1083] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:58:16 2022] GET /identity/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:17.019553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22adf46-5b07-4730-adfc-a2d64f23f8f8 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:17.139044 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22adf46-5b07-4730-adfc-a2d64f23f8f8 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:17.181335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5225a-f0cd-4740-9b69-c654989e43a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:17.181990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5225a-f0cd-4740-9b69-c654989e43a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:17.182269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5225a-f0cd-4740-9b69-c654989e43a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:17.182541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5225a-f0cd-4740-9b69-c654989e43a2 None admin] PATH_INFO: `/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb/users/d905b2b62dfd430686de422a84aba057/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:17.184449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5225a-f0cd-4740-9b69-c654989e43a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fedbc34e20145a8ae8dbedd92d0d0eb, user_id=d905b2b62dfd430686de422a84aba057, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:17.185918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5225a-f0cd-4740-9b69-c654989e43a2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:17.199182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 550/1084] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:58:17 2022] PUT /identity/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb/users/d905b2b62dfd430686de422a84aba057/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:58:18.135316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b835c8-989b-4402-9c2f-71ba3c09de66 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:18.135857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b835c8-989b-4402-9c2f-71ba3c09de66 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:18.135857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b835c8-989b-4402-9c2f-71ba3c09de66 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:18.137386 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 535/1085] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:18.142622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fe77f-a7fc-4a95-8d80-01b5864ab7b4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:18.143043 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fe77f-a7fc-4a95-8d80-01b5864ab7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:18.143259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fe77f-a7fc-4a95-8d80-01b5864ab7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:18.164684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e24fe77f-a7fc-4a95-8d80-01b5864ab7b4 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:18.165903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e24fe77f-a7fc-4a95-8d80-01b5864ab7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:18.194775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:18.234651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 551/1086] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:18.494255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b835c8-989b-4402-9c2f-71ba3c09de66 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:18.544955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:18.602014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b835c8-989b-4402-9c2f-71ba3c09de66 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:18.636445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e9ad4-536b-4a0d-b6e4-27c0a8d93ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:18.637094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e9ad4-536b-4a0d-b6e4-27c0a8d93ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:18.637371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e9ad4-536b-4a0d-b6e4-27c0a8d93ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:18.637637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e9ad4-536b-4a0d-b6e4-27c0a8d93ce5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:18.647948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e9ad4-536b-4a0d-b6e4-27c0a8d93ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-557e9ad4-536b-4a0d-b6e4-27c0a8d93ce5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:58:18.652724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:18.653675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:18.654520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 536/1087] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Sep 19 16:58:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:18.660021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fe77f-a7fc-4a95-8d80-01b5864ab7b4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:18.761015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24fe77f-a7fc-4a95-8d80-01b5864ab7b4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:18.795709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329f72e-abc9-478a-a727-c9b1d526f551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:18.796309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f72e-abc9-478a-a727-c9b1d526f551 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:18.796586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f72e-abc9-478a-a727-c9b1d526f551 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:18.796855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f72e-abc9-478a-a727-c9b1d526f551 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:18.797545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329f72e-abc9-478a-a727-c9b1d526f551 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:18.797847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329f72e-abc9-478a-a727-c9b1d526f551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:18.799210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329f72e-abc9-478a-a727-c9b1d526f551 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:18.807130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 552/1088] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Sep 19 16:58:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:18.813206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e9ad4-536b-4a0d-b6e4-27c0a8d93ce5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:18.924330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e9ad4-536b-4a0d-b6e4-27c0a8d93ce5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:18.926792 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:18.959939 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b42b7-63fc-4f3a-831c-6c06e34bd1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:18.960570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b42b7-63fc-4f3a-831c-6c06e34bd1bb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:18.960845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b42b7-63fc-4f3a-831c-6c06e34bd1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:18.961113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b42b7-63fc-4f3a-831c-6c06e34bd1bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:18.971519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b42b7-63fc-4f3a-831c-6c06e34bd1bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:18.973074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b42b7-63fc-4f3a-831c-6c06e34bd1bb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-886b42b7-63fc-4f3a-831c-6c06e34bd1bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:58:18.987652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:18.988733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:58:18.989703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:58:18.989703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:18.989703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:18.989703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 537/1089] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:18.994836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329f72e-abc9-478a-a727-c9b1d526f551 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:19.026459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:19.101914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329f72e-abc9-478a-a727-c9b1d526f551 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:19.136660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3d80c-04a4-4bff-8afd-15eca56661e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:19.137334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d80c-04a4-4bff-8afd-15eca56661e8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:19.137614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d80c-04a4-4bff-8afd-15eca56661e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:19.137884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3d80c-04a4-4bff-8afd-15eca56661e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:19.138696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3d80c-04a4-4bff-8afd-15eca56661e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:19.138999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3d80c-04a4-4bff-8afd-15eca56661e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:19.140376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3d80c-04a4-4bff-8afd-15eca56661e8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:19.154308 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 553/1090] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:19.160002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b42b7-63fc-4f3a-831c-6c06e34bd1bb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:19.273597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b42b7-63fc-4f3a-831c-6c06e34bd1bb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:19.308571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0906b9-852c-4685-a569-edcfbc518e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:19.309144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0906b9-852c-4685-a569-edcfbc518e86 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:19.309426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0906b9-852c-4685-a569-edcfbc518e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:19.309695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0906b9-852c-4685-a569-edcfbc518e86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:19.317371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0906b9-852c-4685-a569-edcfbc518e86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:19.318822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0906b9-852c-4685-a569-edcfbc518e86 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:19.325148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912c968-886a-4815-9a23-3805cc3f3bcb None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:19.325443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912c968-886a-4815-9a23-3805cc3f3bcb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:19.325716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912c968-886a-4815-9a23-3805cc3f3bcb None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:19.327062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 554/1091] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-fb0906b9-852c-4685-a569-edcfbc518e86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 16:58:19.330102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:19.331287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:19.332781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 538/1092] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Sep 19 16:58:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:19.334626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337c72-c4db-4b28-bee5-88783b7cbd87 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:19.334971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337c72-c4db-4b28-bee5-88783b7cbd87 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:19.335327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1337c72-c4db-4b28-bee5-88783b7cbd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:19.336952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0906b9-852c-4685-a569-edcfbc518e86 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:19.355129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d1337c72-c4db-4b28-bee5-88783b7cbd87 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:19.355363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:19.356486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d1337c72-c4db-4b28-bee5-88783b7cbd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:19.423741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 555/1093] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:19.438208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0906b9-852c-4685-a569-edcfbc518e86 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:19.470878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa74cac-4ba4-4f4d-b986-d0288da01809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:19.471483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa74cac-4ba4-4f4d-b986-d0288da01809 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:19.471765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa74cac-4ba4-4f4d-b986-d0288da01809 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:19.472034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa74cac-4ba4-4f4d-b986-d0288da01809 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:19.472810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa74cac-4ba4-4f4d-b986-d0288da01809 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:19.473151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa74cac-4ba4-4f4d-b986-d0288da01809 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:19.474615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa74cac-4ba4-4f4d-b986-d0288da01809 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:19.492009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 539/1094] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Sep 19 16:58:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:19.498126 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1337c72-c4db-4b28-bee5-88783b7cbd87 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:19.517828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:19.617731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1337c72-c4db-4b28-bee5-88783b7cbd87 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:19.660915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f457c-98fe-458a-924a-91b3f87ecaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:19.661555 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f457c-98fe-458a-924a-91b3f87ecaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:19.661837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f457c-98fe-458a-924a-91b3f87ecaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:19.662116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f457c-98fe-458a-924a-91b3f87ecaa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:19.691296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa74cac-4ba4-4f4d-b986-d0288da01809 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:19.728537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f457c-98fe-458a-924a-91b3f87ecaa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:19.730017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f457c-98fe-458a-924a-91b3f87ecaa1 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:19.748066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:19.769805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:19.795101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa74cac-4ba4-4f4d-b986-d0288da01809 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:19.830321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44882060-2f35-43d2-aad5-b717984076e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:19.830955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882060-2f35-43d2-aad5-b717984076e9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:19.831282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882060-2f35-43d2-aad5-b717984076e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:19.831556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882060-2f35-43d2-aad5-b717984076e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:19.833746 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 556/1095] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:58:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:58:19.839619 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f457c-98fe-458a-924a-91b3f87ecaa1 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:19.841583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44882060-2f35-43d2-aad5-b717984076e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-44882060-2f35-43d2-aad5-b717984076e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:58:19.846366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:19.847297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:19.848227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 540/1096] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:19.853527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44882060-2f35-43d2-aad5-b717984076e9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:19.939814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f457c-98fe-458a-924a-91b3f87ecaa1 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:19.957939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:19.963254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44882060-2f35-43d2-aad5-b717984076e9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:19.977005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805edbd-5656-40e9-9fa8-a2a3ce183d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:19.977659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805edbd-5656-40e9-9fa8-a2a3ce183d6c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:19.977940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805edbd-5656-40e9-9fa8-a2a3ce183d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:19.978213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805edbd-5656-40e9-9fa8-a2a3ce183d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:19.988282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805edbd-5656-40e9-9fa8-a2a3ce183d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:19.989834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805edbd-5656-40e9-9fa8-a2a3ce183d6c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:19.998577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2663b8-d6e2-4114-8b87-0239b850ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:19.999182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2663b8-d6e2-4114-8b87-0239b850ca0f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:19.999455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2663b8-d6e2-4114-8b87-0239b850ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:19.999719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2663b8-d6e2-4114-8b87-0239b850ca0f None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:20.000379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2663b8-d6e2-4114-8b87-0239b850ca0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:20.000672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2663b8-d6e2-4114-8b87-0239b850ca0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:20.002078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2663b8-d6e2-4114-8b87-0239b850ca0f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:20.003412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f805edbd-5656-40e9-9fa8-a2a3ce183d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:58:20.004366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:20.005423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 16:58:20.006569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:58:20.006569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 16:58:20.006569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:20.006569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 557/1097] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:20.011214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 541/1098] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:20.011491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805edbd-5656-40e9-9fa8-a2a3ce183d6c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:20.016928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2663b8-d6e2-4114-8b87-0239b850ca0f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:20.109949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805edbd-5656-40e9-9fa8-a2a3ce183d6c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:20.115127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2663b8-d6e2-4114-8b87-0239b850ca0f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:20.147629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93614a3c-1c0f-499e-afe0-11172ca98f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:20.148248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93614a3c-1c0f-499e-afe0-11172ca98f9c None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:20.148528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93614a3c-1c0f-499e-afe0-11172ca98f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:20.148798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93614a3c-1c0f-499e-afe0-11172ca98f9c None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:20.149473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93614a3c-1c0f-499e-afe0-11172ca98f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:20.149774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93614a3c-1c0f-499e-afe0-11172ca98f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:20.151138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93614a3c-1c0f-499e-afe0-11172ca98f9c None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:20.151691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebd657-f23d-4c5b-9e9b-9f710213fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:20.152358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebd657-f23d-4c5b-9e9b-9f710213fcaf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:20.152638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebd657-f23d-4c5b-9e9b-9f710213fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:20.152911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebd657-f23d-4c5b-9e9b-9f710213fcaf None admin] PATH_INFO: `/v3/users/d905b2b62dfd430686de422a84aba057` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:20.154089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebd657-f23d-4c5b-9e9b-9f710213fcaf None admin] RBAC: Authorizing `identity:get_user(user_id=d905b2b62dfd430686de422a84aba057)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:20.155510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebd657-f23d-4c5b-9e9b-9f710213fcaf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:20.157128 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 542/1099] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:20 2022] GET /identity/v3/users/d905b2b62dfd430686de422a84aba057 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:20.162781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebd657-f23d-4c5b-9e9b-9f710213fcaf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:20.164553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 558/1100] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 16:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:20.169929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93614a3c-1c0f-499e-afe0-11172ca98f9c None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:20.199566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:20.222630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:20.260904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebd657-f23d-4c5b-9e9b-9f710213fcaf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:20.268107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93614a3c-1c0f-499e-afe0-11172ca98f9c None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:20.295205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7b0b9-e3b6-470d-bdeb-6419bef811b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:20.295832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7b0b9-e3b6-470d-bdeb-6419bef811b5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:20.296113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7b0b9-e3b6-470d-bdeb-6419bef811b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:20.296397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7b0b9-e3b6-470d-bdeb-6419bef811b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:20.300893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0ce2e-7550-430f-8ba4-0db95f4621bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:20.301544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0ce2e-7550-430f-8ba4-0db95f4621bd None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:20.301818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0ce2e-7550-430f-8ba4-0db95f4621bd None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:20.302088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0ce2e-7550-430f-8ba4-0db95f4621bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:20.308537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0ce2e-7550-430f-8ba4-0db95f4621bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:20.309998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0ce2e-7550-430f-8ba4-0db95f4621bd None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-23a0ce2e-7550-430f-8ba4-0db95f4621bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 16:58:20.320906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:20.321973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:20.322877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 16:58:20.322877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 16:58:20.322877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:58:20.322877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:58:20.322877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:58:20.322877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:58:20.322877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 16:58:20.322877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:20.326996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 559/1101] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 16:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 16:58:20.327867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0ce2e-7550-430f-8ba4-0db95f4621bd None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:20.363581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7b0b9-e3b6-470d-bdeb-6419bef811b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:20.365066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7b0b9-e3b6-470d-bdeb-6419bef811b5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:20.418415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:20.424800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:20.428968 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0ce2e-7550-430f-8ba4-0db95f4621bd None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:20.461570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 543/1102] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:58:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 16:58:20.461749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283219aa-7c73-44ad-8cb1-753cd9cffe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:20.462112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283219aa-7c73-44ad-8cb1-753cd9cffe73 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:20.462394 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283219aa-7c73-44ad-8cb1-753cd9cffe73 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:20.462670 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283219aa-7c73-44ad-8cb1-753cd9cffe73 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:20.463371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283219aa-7c73-44ad-8cb1-753cd9cffe73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:20.463676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283219aa-7c73-44ad-8cb1-753cd9cffe73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:20.465138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283219aa-7c73-44ad-8cb1-753cd9cffe73 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:20.467669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7b0b9-e3b6-470d-bdeb-6419bef811b5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:20.477247 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 560/1103] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 16:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:20.483186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283219aa-7c73-44ad-8cb1-753cd9cffe73 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:20.564561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7b0b9-e3b6-470d-bdeb-6419bef811b5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:20.580644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283219aa-7c73-44ad-8cb1-753cd9cffe73 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:20.597332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69755acb-5db1-4477-ae16-b8e6d5f11f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:20.598005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69755acb-5db1-4477-ae16-b8e6d5f11f70 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:20.598308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69755acb-5db1-4477-ae16-b8e6d5f11f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:20.598576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69755acb-5db1-4477-ae16-b8e6d5f11f70 None admin] PATH_INFO: `/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:20.599701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69755acb-5db1-4477-ae16-b8e6d5f11f70 None admin] RBAC: Authorizing `identity:get_project(project_id=5fedbc34e20145a8ae8dbedd92d0d0eb)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:20.601170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69755acb-5db1-4477-ae16-b8e6d5f11f70 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:20.602815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 544/1104] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:58:20 2022] GET /identity/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:20.608894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69755acb-5db1-4477-ae16-b8e6d5f11f70 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:20.614151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3996e7-3897-45a8-ac3f-53a6c6572ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:20.614758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3996e7-3897-45a8-ac3f-53a6c6572ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:20.615041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3996e7-3897-45a8-ac3f-53a6c6572ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:20.615312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3996e7-3897-45a8-ac3f-53a6c6572ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:20.616040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3996e7-3897-45a8-ac3f-53a6c6572ea3 None admin] RBAC: Adding query filter params (role.id=df4a78a83b4846d5b311f4b9f038b434, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=ea18c782ddf2469fa3d10a135fc34c37) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:20.616345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3996e7-3897-45a8-ac3f-53a6c6572ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:20.617809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3996e7-3897-45a8-ac3f-53a6c6572ea3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:20.623661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 561/1105] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:58:20 2022] GET /identity/v3/role_assignments?user.id=ea18c782ddf2469fa3d10a135fc34c37&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=df4a78a83b4846d5b311f4b9f038b434 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:20.640804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:20.719277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69755acb-5db1-4477-ae16-b8e6d5f11f70 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:20.757964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d20c0-b3fe-44fe-b610-2fea6ff4f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:20.758577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d20c0-b3fe-44fe-b610-2fea6ff4f67b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:20.758852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d20c0-b3fe-44fe-b610-2fea6ff4f67b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:20.759119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d20c0-b3fe-44fe-b610-2fea6ff4f67b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:20.759862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d20c0-b3fe-44fe-b610-2fea6ff4f67b None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=5fedbc34e20145a8ae8dbedd92d0d0eb, user.id=d905b2b62dfd430686de422a84aba057) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:20.760164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d20c0-b3fe-44fe-b610-2fea6ff4f67b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:20.761688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d20c0-b3fe-44fe-b610-2fea6ff4f67b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:20.768351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 545/1106] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:58:20 2022] GET /identity/v3/role_assignments?user.id=d905b2b62dfd430686de422a84aba057&scope.project.id=5fedbc34e20145a8ae8dbedd92d0d0eb&role.id=77285ef607e34662b6234656fe8043d0 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:22.970905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95a2b4-f151-4884-beb5-fec374d863db None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:22.971474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95a2b4-f151-4884-beb5-fec374d863db None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:22.971474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95a2b4-f151-4884-beb5-fec374d863db None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:22.972889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 562/1107] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:22.979275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425357c-9842-4330-9107-a1d0b9990b68 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:22.979741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425357c-9842-4330-9107-a1d0b9990b68 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:22.979846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425357c-9842-4330-9107-a1d0b9990b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:23.007755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4425357c-9842-4330-9107-a1d0b9990b68 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:23.008948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4425357c-9842-4330-9107-a1d0b9990b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:23.081157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 546/1108] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:23.349454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95a2b4-f151-4884-beb5-fec374d863db None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:23.371386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:23.461195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95a2b4-f151-4884-beb5-fec374d863db None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:23.496489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633adf69-b840-446a-9018-2702238ca649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:23.497130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633adf69-b840-446a-9018-2702238ca649 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:23.497414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633adf69-b840-446a-9018-2702238ca649 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:23.497684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633adf69-b840-446a-9018-2702238ca649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:23.498836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633adf69-b840-446a-9018-2702238ca649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:23.500270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633adf69-b840-446a-9018-2702238ca649 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:23.501857 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 563/1109] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:23.510771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425357c-9842-4330-9107-a1d0b9990b68 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:23.542565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:23.618004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425357c-9842-4330-9107-a1d0b9990b68 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:23.662062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef0582-4fa8-4304-9494-279073295433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:23.662677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef0582-4fa8-4304-9494-279073295433 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:23.662955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef0582-4fa8-4304-9494-279073295433 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:23.663219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef0582-4fa8-4304-9494-279073295433 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:23.663875 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef0582-4fa8-4304-9494-279073295433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:23.665367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef0582-4fa8-4304-9494-279073295433 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:23.688706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 547/1110] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:58:23 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:58:25.848580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4b7b9-0807-4c62-8fbd-e713bb300ff4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:25.849159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4b7b9-0807-4c62-8fbd-e713bb300ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:25.849159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4b7b9-0807-4c62-8fbd-e713bb300ff4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:25.850514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 564/1111] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:25.855965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040beca-2b8b-4409-9ee3-2643ea6bc254 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:25.856411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040beca-2b8b-4409-9ee3-2643ea6bc254 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:25.856527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040beca-2b8b-4409-9ee3-2643ea6bc254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:25.876330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f040beca-2b8b-4409-9ee3-2643ea6bc254 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:25.877579 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f040beca-2b8b-4409-9ee3-2643ea6bc254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:25.957583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 548/1112] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:26.222965 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4b7b9-0807-4c62-8fbd-e713bb300ff4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:26.318635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:26.343695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4b7b9-0807-4c62-8fbd-e713bb300ff4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:26.378268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03605-0b16-43f3-806a-1b93537e9f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:26.378936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03605-0b16-43f3-806a-1b93537e9f2b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:26.379218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03605-0b16-43f3-806a-1b93537e9f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:26.379486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03605-0b16-43f3-806a-1b93537e9f2b None admin] PATH_INFO: `/v3/roles/ee6045909540420b8b406a308fdad516` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:26.380995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d03605-0b16-43f3-806a-1b93537e9f2b None admin] RBAC: Authorizing `identity:get_role(role_id=ee6045909540420b8b406a308fdad516)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:26.382397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d03605-0b16-43f3-806a-1b93537e9f2b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:26.383695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 565/1113] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:26 2022] GET /identity/v3/roles/ee6045909540420b8b406a308fdad516 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:26.389994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040beca-2b8b-4409-9ee3-2643ea6bc254 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:26.406565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:26.494832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040beca-2b8b-4409-9ee3-2643ea6bc254 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:26.530265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c168569-5314-4c56-80e0-f512eb1c8783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:26.530885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c168569-5314-4c56-80e0-f512eb1c8783 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:26.531163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c168569-5314-4c56-80e0-f512eb1c8783 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:26.531430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c168569-5314-4c56-80e0-f512eb1c8783 None admin] PATH_INFO: `/v3/users/18a2a3ca37eb42d09a7214675a94dbb2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:26.544904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c168569-5314-4c56-80e0-f512eb1c8783 None admin] RBAC: Authorizing `identity:get_user(user_id=18a2a3ca37eb42d09a7214675a94dbb2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:26.546379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c168569-5314-4c56-80e0-f512eb1c8783 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:26.547978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 549/1114] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:26 2022] GET /identity/v3/users/18a2a3ca37eb42d09a7214675a94dbb2 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:26.554015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03605-0b16-43f3-806a-1b93537e9f2b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:26.659895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03605-0b16-43f3-806a-1b93537e9f2b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:26.696773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed082ca5-f692-4059-9ce9-1632528a63a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:26.697390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed082ca5-f692-4059-9ce9-1632528a63a4 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:26.697666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed082ca5-f692-4059-9ce9-1632528a63a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:26.697935 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed082ca5-f692-4059-9ce9-1632528a63a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:26.716014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:26.769934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed082ca5-f692-4059-9ce9-1632528a63a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:26.771372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed082ca5-f692-4059-9ce9-1632528a63a4 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:26.868641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 566/1115] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:58:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:58:26.878110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c168569-5314-4c56-80e0-f512eb1c8783 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:26.951272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:26.983324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c168569-5314-4c56-80e0-f512eb1c8783 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:27.019993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b2fe8-ad08-4d7b-8149-667ce8bd2b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:27.020612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2fe8-ad08-4d7b-8149-667ce8bd2b65 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:27.020887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2fe8-ad08-4d7b-8149-667ce8bd2b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:27.021186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b2fe8-ad08-4d7b-8149-667ce8bd2b65 None admin] PATH_INFO: `/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:27.022327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b2fe8-ad08-4d7b-8149-667ce8bd2b65 None admin] RBAC: Authorizing `identity:get_project(project_id=5fedbc34e20145a8ae8dbedd92d0d0eb)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:27.023752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b2fe8-ad08-4d7b-8149-667ce8bd2b65 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:27.025415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 550/1116] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:58:26 2022] GET /identity/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:27.034536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed082ca5-f692-4059-9ce9-1632528a63a4 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:27.084459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:27.146175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed082ca5-f692-4059-9ce9-1632528a63a4 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:27.184979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db28bef-bee7-4471-909e-105139055106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:27.185612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db28bef-bee7-4471-909e-105139055106 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:27.185895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db28bef-bee7-4471-909e-105139055106 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:27.186166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db28bef-bee7-4471-909e-105139055106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:27.186893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db28bef-bee7-4471-909e-105139055106 None admin] RBAC: Adding query filter params (role.id=ee6045909540420b8b406a308fdad516, scope.project.id=5fedbc34e20145a8ae8dbedd92d0d0eb, user.id=18a2a3ca37eb42d09a7214675a94dbb2) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:27.187199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db28bef-bee7-4471-909e-105139055106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:27.188674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db28bef-bee7-4471-909e-105139055106 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:27.194278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 567/1117] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:58:27 2022] GET /identity/v3/role_assignments?user.id=18a2a3ca37eb42d09a7214675a94dbb2&scope.project.id=5fedbc34e20145a8ae8dbedd92d0d0eb&role.id=ee6045909540420b8b406a308fdad516 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:29.275231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7887d98-9902-4c93-bfdf-cc9464a0fcc1 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:29.275858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7887d98-9902-4c93-bfdf-cc9464a0fcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:29.275858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7887d98-9902-4c93-bfdf-cc9464a0fcc1 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:29.277170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 551/1118] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:29.283431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f77d0-f094-4389-9821-12f0bbabf1b7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:29.284116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f77d0-f094-4389-9821-12f0bbabf1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:29.284305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f77d0-f094-4389-9821-12f0bbabf1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:29.309907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f26f77d0-f094-4389-9821-12f0bbabf1b7 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:29.311105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f26f77d0-f094-4389-9821-12f0bbabf1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:29.382104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 568/1119] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:29.658801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7887d98-9902-4c93-bfdf-cc9464a0fcc1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:29.773444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7887d98-9902-4c93-bfdf-cc9464a0fcc1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:29.815776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3201a-aa90-403b-ae3c-af40b7239937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:29.816781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3201a-aa90-403b-ae3c-af40b7239937 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:29.817269 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3201a-aa90-403b-ae3c-af40b7239937 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:29.817679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3201a-aa90-403b-ae3c-af40b7239937 None admin] PATH_INFO: `/v3/roles/ee6045909540420b8b406a308fdad516` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:29.820056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3201a-aa90-403b-ae3c-af40b7239937 None admin] RBAC: Authorizing `identity:get_role(role_id=ee6045909540420b8b406a308fdad516)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:29.822190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3201a-aa90-403b-ae3c-af40b7239937 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:29.823587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 552/1120] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:29 2022] GET /identity/v3/roles/ee6045909540420b8b406a308fdad516 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:29.832306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f77d0-f094-4389-9821-12f0bbabf1b7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:29.890246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:29.955805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f77d0-f094-4389-9821-12f0bbabf1b7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:29.989871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e9d6d-4a3d-4eb9-9681-daf46d442c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:29.990492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e9d6d-4a3d-4eb9-9681-daf46d442c14 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:29.990778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e9d6d-4a3d-4eb9-9681-daf46d442c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:29.991052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e9d6d-4a3d-4eb9-9681-daf46d442c14 None admin] PATH_INFO: `/v3/users/18a2a3ca37eb42d09a7214675a94dbb2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:29.992190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e9d6d-4a3d-4eb9-9681-daf46d442c14 None admin] RBAC: Authorizing `identity:get_user(user_id=18a2a3ca37eb42d09a7214675a94dbb2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:29.993663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e9d6d-4a3d-4eb9-9681-daf46d442c14 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:29.995232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 569/1121] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:29 2022] GET /identity/v3/users/18a2a3ca37eb42d09a7214675a94dbb2 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:30.001355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3201a-aa90-403b-ae3c-af40b7239937 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:30.010352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:30.120910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3201a-aa90-403b-ae3c-af40b7239937 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:30.164666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a463bb-6d00-492c-b666-c6741110a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:30.165345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a463bb-6d00-492c-b666-c6741110a72b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:30.165622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a463bb-6d00-492c-b666-c6741110a72b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:30.165897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a463bb-6d00-492c-b666-c6741110a72b None admin] PATH_INFO: `/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:30.167061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a463bb-6d00-492c-b666-c6741110a72b None admin] RBAC: Authorizing `identity:get_project(project_id=5fedbc34e20145a8ae8dbedd92d0d0eb)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:30.168530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a463bb-6d00-492c-b666-c6741110a72b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:30.170257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 553/1122] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:58:30 2022] GET /identity/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:30.179501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e9d6d-4a3d-4eb9-9681-daf46d442c14 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:30.297539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e9d6d-4a3d-4eb9-9681-daf46d442c14 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:30.310373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:30.334761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff4db-5201-431f-93e0-2e7aa5508f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:30.335412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff4db-5201-431f-93e0-2e7aa5508f69 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:30.335688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff4db-5201-431f-93e0-2e7aa5508f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:30.335961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff4db-5201-431f-93e0-2e7aa5508f69 None admin] PATH_INFO: `/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb/users/18a2a3ca37eb42d09a7214675a94dbb2/roles/ee6045909540420b8b406a308fdad516` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:30.338152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ff4db-5201-431f-93e0-2e7aa5508f69 None admin] RBAC: Authorizing `identity:create_grant(project_id=5fedbc34e20145a8ae8dbedd92d0d0eb, user_id=18a2a3ca37eb42d09a7214675a94dbb2, role_id=ee6045909540420b8b406a308fdad516)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:30.339590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ff4db-5201-431f-93e0-2e7aa5508f69 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:30.354117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 570/1123] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:58:30 2022] PUT /identity/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb/users/18a2a3ca37eb42d09a7214675a94dbb2/roles/ee6045909540420b8b406a308fdad516 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:58:32.439035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09e53-e2a7-4108-afa6-c0f0753b3dc3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:32.439850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09e53-e2a7-4108-afa6-c0f0753b3dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:32.439850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09e53-e2a7-4108-afa6-c0f0753b3dc3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:32.441705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 554/1124] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:32.447420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb3c4-df82-4f51-a41d-80d8a5658ca0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:32.447833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb3c4-df82-4f51-a41d-80d8a5658ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:32.447955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb3c4-df82-4f51-a41d-80d8a5658ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:32.467892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-271bb3c4-df82-4f51-a41d-80d8a5658ca0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:32.469070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-271bb3c4-df82-4f51-a41d-80d8a5658ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:32.538016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 571/1125] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:32.803399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b09e53-e2a7-4108-afa6-c0f0753b3dc3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:32.909986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:32.939303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b09e53-e2a7-4108-afa6-c0f0753b3dc3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:32.981693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dbd87-fc9b-4efb-912d-710550ed64b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:32.982316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dbd87-fc9b-4efb-912d-710550ed64b8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:32.982575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dbd87-fc9b-4efb-912d-710550ed64b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:32.982869 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dbd87-fc9b-4efb-912d-710550ed64b8 None admin] PATH_INFO: `/v3/roles/ee6045909540420b8b406a308fdad516` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:32.984316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dbd87-fc9b-4efb-912d-710550ed64b8 None admin] RBAC: Authorizing `identity:get_role(role_id=ee6045909540420b8b406a308fdad516)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:32.985735 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dbd87-fc9b-4efb-912d-710550ed64b8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:32.987073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 555/1126] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:32 2022] GET /identity/v3/roles/ee6045909540420b8b406a308fdad516 => generated 223 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:32.993526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb3c4-df82-4f51-a41d-80d8a5658ca0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:33.094351 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb3c4-df82-4f51-a41d-80d8a5658ca0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:33.095837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:33.131236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dafe4-9cda-4a6c-926d-a0aab7c70fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:33.131865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dafe4-9cda-4a6c-926d-a0aab7c70fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:33.132142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dafe4-9cda-4a6c-926d-a0aab7c70fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:33.132419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dafe4-9cda-4a6c-926d-a0aab7c70fa7 None admin] PATH_INFO: `/v3/users/18a2a3ca37eb42d09a7214675a94dbb2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:33.133691 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dafe4-9cda-4a6c-926d-a0aab7c70fa7 None admin] RBAC: Authorizing `identity:get_user(user_id=18a2a3ca37eb42d09a7214675a94dbb2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:33.135129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dafe4-9cda-4a6c-926d-a0aab7c70fa7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:33.137343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 572/1127] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:32 2022] GET /identity/v3/users/18a2a3ca37eb42d09a7214675a94dbb2 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:33.143051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dbd87-fc9b-4efb-912d-710550ed64b8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:33.256160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dbd87-fc9b-4efb-912d-710550ed64b8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:33.299506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adb652-742d-4922-a868-284b7921773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:33.300117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adb652-742d-4922-a868-284b7921773c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:33.300396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adb652-742d-4922-a868-284b7921773c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:33.300667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adb652-742d-4922-a868-284b7921773c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:33.314026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:33.374568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adb652-742d-4922-a868-284b7921773c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:33.375958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adb652-742d-4922-a868-284b7921773c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:33.478845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 556/1128] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:58:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:58:33.485215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dafe4-9cda-4a6c-926d-a0aab7c70fa7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:33.593343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dafe4-9cda-4a6c-926d-a0aab7c70fa7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:33.628629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d5bf1-e15f-462d-b2a6-ec7c89059c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:33.629219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d5bf1-e15f-462d-b2a6-ec7c89059c70 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:33.629494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d5bf1-e15f-462d-b2a6-ec7c89059c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:33.629767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d5bf1-e15f-462d-b2a6-ec7c89059c70 None admin] PATH_INFO: `/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:33.631008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d5bf1-e15f-462d-b2a6-ec7c89059c70 None admin] RBAC: Authorizing `identity:get_project(project_id=5fedbc34e20145a8ae8dbedd92d0d0eb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:33.632446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d5bf1-e15f-462d-b2a6-ec7c89059c70 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:33.634102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 573/1129] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:58:33 2022] GET /identity/v3/projects/5fedbc34e20145a8ae8dbedd92d0d0eb => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:33.640983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adb652-742d-4922-a868-284b7921773c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:33.691127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:33.753023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adb652-742d-4922-a868-284b7921773c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:33.789821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9131e4-4bec-4484-ae10-7aa276f8ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:33.790429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9131e4-4bec-4484-ae10-7aa276f8ec11 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:33.790707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9131e4-4bec-4484-ae10-7aa276f8ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:33.790977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9131e4-4bec-4484-ae10-7aa276f8ec11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:33.791708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9131e4-4bec-4484-ae10-7aa276f8ec11 None admin] RBAC: Adding query filter params (role.id=ee6045909540420b8b406a308fdad516, scope.project.id=5fedbc34e20145a8ae8dbedd92d0d0eb, user.id=18a2a3ca37eb42d09a7214675a94dbb2) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:33.792014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9131e4-4bec-4484-ae10-7aa276f8ec11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:33.793494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9131e4-4bec-4484-ae10-7aa276f8ec11 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:33.799540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 557/1130] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:58:33 2022] GET /identity/v3/role_assignments?user.id=18a2a3ca37eb42d09a7214675a94dbb2&scope.project.id=5fedbc34e20145a8ae8dbedd92d0d0eb&role.id=ee6045909540420b8b406a308fdad516 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:35.955544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f570b-e965-4082-9ba6-b0fb70ac8d13 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:35.956563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f570b-e965-4082-9ba6-b0fb70ac8d13 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:35.956563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f570b-e965-4082-9ba6-b0fb70ac8d13 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:35.957961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 574/1131] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:35.966704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9706-360b-41a9-8e28-ec8d09562157 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:35.967421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9706-360b-41a9-8e28-ec8d09562157 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:35.967583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa9706-360b-41a9-8e28-ec8d09562157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:35.994281 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c5fa9706-360b-41a9-8e28-ec8d09562157 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:35.995477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c5fa9706-360b-41a9-8e28-ec8d09562157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:36.065487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 558/1132] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:36.326014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f570b-e965-4082-9ba6-b0fb70ac8d13 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:36.378603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:36.440948 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f570b-e965-4082-9ba6-b0fb70ac8d13 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:36.477934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79223-59e7-4b78-9869-5a3daf61c2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:36.478895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79223-59e7-4b78-9869-5a3daf61c2ed None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:36.479323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79223-59e7-4b78-9869-5a3daf61c2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:36.479752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79223-59e7-4b78-9869-5a3daf61c2ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:36.481839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f79223-59e7-4b78-9869-5a3daf61c2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:36.484135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f79223-59e7-4b78-9869-5a3daf61c2ed None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:36.486637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 575/1133] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:36.496002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa9706-360b-41a9-8e28-ec8d09562157 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:36.534423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:36.606814 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa9706-360b-41a9-8e28-ec8d09562157 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:36.641046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab6e55-05db-4441-99a9-adc6434d9fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:36.641657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab6e55-05db-4441-99a9-adc6434d9fad None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:36.641931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab6e55-05db-4441-99a9-adc6434d9fad None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:36.642199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab6e55-05db-4441-99a9-adc6434d9fad None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:36.642848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab6e55-05db-4441-99a9-adc6434d9fad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:36.644701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab6e55-05db-4441-99a9-adc6434d9fad None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:36.673597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 559/1134] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:58:36 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:58:38.826198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237e34-6d32-4dc3-b682-e90612711cb9 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:38.827066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237e34-6d32-4dc3-b682-e90612711cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:38.827066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237e34-6d32-4dc3-b682-e90612711cb9 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:38.829339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 576/1135] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:38.835282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b9f0d-8d84-4c04-8469-0874ca91dd89 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:38.835718 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b9f0d-8d84-4c04-8469-0874ca91dd89 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:38.835811 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b9f0d-8d84-4c04-8469-0874ca91dd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:38.855681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-991b9f0d-8d84-4c04-8469-0874ca91dd89 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:38.856860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-991b9f0d-8d84-4c04-8469-0874ca91dd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:38.925555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 560/1136] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:39.189441 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3237e34-6d32-4dc3-b682-e90612711cb9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:39.307058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3237e34-6d32-4dc3-b682-e90612711cb9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:39.315039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:39.348521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796299d6-03e3-446c-b14e-75533befe295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:39.349192 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796299d6-03e3-446c-b14e-75533befe295 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:39.349474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796299d6-03e3-446c-b14e-75533befe295 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:39.349741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796299d6-03e3-446c-b14e-75533befe295 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:39.351074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796299d6-03e3-446c-b14e-75533befe295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:39.352517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796299d6-03e3-446c-b14e-75533befe295 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:39.354385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 577/1137] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 16:58:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:39.360302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b9f0d-8d84-4c04-8469-0874ca91dd89 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:39.381291 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:39.470233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b9f0d-8d84-4c04-8469-0874ca91dd89 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:39.506799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f983b82-027e-4414-9575-f1f7d4d07067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:39.507408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983b82-027e-4414-9575-f1f7d4d07067 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:39.507689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983b82-027e-4414-9575-f1f7d4d07067 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:39.507961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f983b82-027e-4414-9575-f1f7d4d07067 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:39.508613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f983b82-027e-4414-9575-f1f7d4d07067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:39.510099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f983b82-027e-4414-9575-f1f7d4d07067 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:39.537390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 561/1138] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:58:39 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:58:41.702237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56835563-45cf-438c-b908-3bda1a66aa95 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:41.703120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56835563-45cf-438c-b908-3bda1a66aa95 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:41.703120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56835563-45cf-438c-b908-3bda1a66aa95 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:41.705252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 578/1139] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:41.714026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbfc1c-1dc6-4f11-8657-3e2e39afa1c5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:41.714467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbfc1c-1dc6-4f11-8657-3e2e39afa1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:41.714594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbfc1c-1dc6-4f11-8657-3e2e39afa1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:41.737585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-32dbfc1c-1dc6-4f11-8657-3e2e39afa1c5 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:41.738779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-32dbfc1c-1dc6-4f11-8657-3e2e39afa1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:41.811440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 562/1140] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:42.083201 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56835563-45cf-438c-b908-3bda1a66aa95 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:42.189659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56835563-45cf-438c-b908-3bda1a66aa95 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:42.224599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2026-dc5e-4fb2-b4b0-3835dd474ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:42.225246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2026-dc5e-4fb2-b4b0-3835dd474ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:42.225528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2026-dc5e-4fb2-b4b0-3835dd474ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:42.225801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2026-dc5e-4fb2-b4b0-3835dd474ec5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:42.236024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c2026-dc5e-4fb2-b4b0-3835dd474ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-787c2026-dc5e-4fb2-b4b0-3835dd474ec5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:58:42.240814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:42.241822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:42.242930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 579/1141] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:42.248347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbfc1c-1dc6-4f11-8657-3e2e39afa1c5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:42.251861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:42.351367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbfc1c-1dc6-4f11-8657-3e2e39afa1c5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:42.387722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0353-202b-4942-8069-fbb0772463c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:42.388325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0353-202b-4942-8069-fbb0772463c2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:42.388603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0353-202b-4942-8069-fbb0772463c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:42.388864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0353-202b-4942-8069-fbb0772463c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:42.389553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f0353-202b-4942-8069-fbb0772463c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:42.389850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f0353-202b-4942-8069-fbb0772463c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:42.391209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f0353-202b-4942-8069-fbb0772463c2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:42.400519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 563/1142] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:42.406845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2026-dc5e-4fb2-b4b0-3835dd474ec5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:42.443067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:42.520718 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2026-dc5e-4fb2-b4b0-3835dd474ec5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:42.555418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d99666-0662-447d-ae78-4eb4ee36bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:42.556029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d99666-0662-447d-ae78-4eb4ee36bb71 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:42.556309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d99666-0662-447d-ae78-4eb4ee36bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:42.556581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d99666-0662-447d-ae78-4eb4ee36bb71 None admin] PATH_INFO: `/v3/users/76ec81b1281c4a0fa168e4d9ae2ad6d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:42.569740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d99666-0662-447d-ae78-4eb4ee36bb71 None admin] RBAC: Authorizing `identity:get_user(user_id=76ec81b1281c4a0fa168e4d9ae2ad6d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:42.571184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d99666-0662-447d-ae78-4eb4ee36bb71 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:42.572780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 580/1143] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:42 2022] GET /identity/v3/users/76ec81b1281c4a0fa168e4d9ae2ad6d0 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:42.578860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0353-202b-4942-8069-fbb0772463c2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:42.650272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:42.697053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0353-202b-4942-8069-fbb0772463c2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:42.732858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fe850-c496-49bc-990d-4dd7f9ab7111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:42.733540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fe850-c496-49bc-990d-4dd7f9ab7111 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:42.733776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fe850-c496-49bc-990d-4dd7f9ab7111 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:42.734047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fe850-c496-49bc-990d-4dd7f9ab7111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:42.805500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fe850-c496-49bc-990d-4dd7f9ab7111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:42.806960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fe850-c496-49bc-990d-4dd7f9ab7111 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:42.880329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:42.930055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 564/1144] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:58:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:58:42.936299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d99666-0662-447d-ae78-4eb4ee36bb71 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:43.034146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:43.048775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d99666-0662-447d-ae78-4eb4ee36bb71 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:43.088861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7d832-8005-4975-b29a-a8b0e4ea5176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:43.089508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d832-8005-4975-b29a-a8b0e4ea5176 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:43.089781 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d832-8005-4975-b29a-a8b0e4ea5176 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:43.090047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d832-8005-4975-b29a-a8b0e4ea5176 None admin] PATH_INFO: `/v3/projects/d4e34490401644579c12192562b164b3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:43.091270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7d832-8005-4975-b29a-a8b0e4ea5176 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e34490401644579c12192562b164b3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:43.092694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7d832-8005-4975-b29a-a8b0e4ea5176 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:43.094381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 581/1145] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:58:42 2022] GET /identity/v3/projects/d4e34490401644579c12192562b164b3 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:43.102313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fe850-c496-49bc-990d-4dd7f9ab7111 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:43.207584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fe850-c496-49bc-990d-4dd7f9ab7111 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:43.243518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e400009-3086-4007-9cb0-6f161a5bdf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:43.244129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400009-3086-4007-9cb0-6f161a5bdf00 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:43.244407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400009-3086-4007-9cb0-6f161a5bdf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:43.244678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400009-3086-4007-9cb0-6f161a5bdf00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:43.245436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e400009-3086-4007-9cb0-6f161a5bdf00 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=d4e34490401644579c12192562b164b3, user.id=76ec81b1281c4a0fa168e4d9ae2ad6d0) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:43.245748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e400009-3086-4007-9cb0-6f161a5bdf00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:43.247177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e400009-3086-4007-9cb0-6f161a5bdf00 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:43.252730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 565/1146] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:58:43 2022] GET /identity/v3/role_assignments?user.id=76ec81b1281c4a0fa168e4d9ae2ad6d0&scope.project.id=d4e34490401644579c12192562b164b3&role.id=77285ef607e34662b6234656fe8043d0 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:45.328331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a991906-faa9-4ec0-9b8e-4c4f885fdc14 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:45.329199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a991906-faa9-4ec0-9b8e-4c4f885fdc14 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:45.329199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a991906-faa9-4ec0-9b8e-4c4f885fdc14 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:45.331384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 582/1147] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:45.339335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d1313-4c81-433c-b380-4f61dfe560e9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:45.339763 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d1313-4c81-433c-b380-4f61dfe560e9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:45.339853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d1313-4c81-433c-b380-4f61dfe560e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:45.359416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2a8d1313-4c81-433c-b380-4f61dfe560e9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:45.360593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2a8d1313-4c81-433c-b380-4f61dfe560e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:45.391313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:45.440512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 566/1148] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:58:45.718025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a991906-faa9-4ec0-9b8e-4c4f885fdc14 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:45.824952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a991906-faa9-4ec0-9b8e-4c4f885fdc14 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:45.862239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349153-218d-45bf-8809-623b58291316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:45.862856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349153-218d-45bf-8809-623b58291316 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:45.863136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349153-218d-45bf-8809-623b58291316 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:45.863402 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a349153-218d-45bf-8809-623b58291316 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:45.874898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a349153-218d-45bf-8809-623b58291316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3a349153-218d-45bf-8809-623b58291316 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:58:45.879849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:45.880938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:45.882008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:45.885223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 583/1149] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:58:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:45.887186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d1313-4c81-433c-b380-4f61dfe560e9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:45.995747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d1313-4c81-433c-b380-4f61dfe560e9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:46.034682 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e089d58-7bd8-40dc-9ace-51472bf04697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:46.035283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e089d58-7bd8-40dc-9ace-51472bf04697 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:46.035644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e089d58-7bd8-40dc-9ace-51472bf04697 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:46.035920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e089d58-7bd8-40dc-9ace-51472bf04697 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:46.036589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e089d58-7bd8-40dc-9ace-51472bf04697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:46.036890 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e089d58-7bd8-40dc-9ace-51472bf04697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:46.038294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e089d58-7bd8-40dc-9ace-51472bf04697 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:46.056364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 567/1150] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:58:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:46.063212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349153-218d-45bf-8809-623b58291316 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:46.088405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:46.170984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a349153-218d-45bf-8809-623b58291316 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:46.205864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2682dd5-a565-46b1-8099-e4d62520fca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:46.206497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682dd5-a565-46b1-8099-e4d62520fca6 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:46.206777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682dd5-a565-46b1-8099-e4d62520fca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:46.207048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682dd5-a565-46b1-8099-e4d62520fca6 None admin] PATH_INFO: `/v3/users/76ec81b1281c4a0fa168e4d9ae2ad6d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:46.208245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2682dd5-a565-46b1-8099-e4d62520fca6 None admin] RBAC: Authorizing `identity:get_user(user_id=76ec81b1281c4a0fa168e4d9ae2ad6d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:46.209711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2682dd5-a565-46b1-8099-e4d62520fca6 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:46.211294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 584/1151] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:46 2022] GET /identity/v3/users/76ec81b1281c4a0fa168e4d9ae2ad6d0 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:46.217577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e089d58-7bd8-40dc-9ace-51472bf04697 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:46.243978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:46.321522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e089d58-7bd8-40dc-9ace-51472bf04697 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:46.362959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b46c0-a371-422e-a254-f67dd8c47a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:46.363956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b46c0-a371-422e-a254-f67dd8c47a92 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:46.364253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b46c0-a371-422e-a254-f67dd8c47a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:46.364529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b46c0-a371-422e-a254-f67dd8c47a92 None admin] PATH_INFO: `/v3/projects/d4e34490401644579c12192562b164b3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:46.365911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b46c0-a371-422e-a254-f67dd8c47a92 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e34490401644579c12192562b164b3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:46.367398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b46c0-a371-422e-a254-f67dd8c47a92 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:46.369015 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 568/1152] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:58:46 2022] GET /identity/v3/projects/d4e34490401644579c12192562b164b3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:58:46.375357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2682dd5-a565-46b1-8099-e4d62520fca6 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:46.475588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:46.493301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2682dd5-a565-46b1-8099-e4d62520fca6 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:46.529939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a363b-037b-44d1-a741-60c7a1c02a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:46.530932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a363b-037b-44d1-a741-60c7a1c02a2f None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:46.531337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a363b-037b-44d1-a741-60c7a1c02a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:46.531737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a363b-037b-44d1-a741-60c7a1c02a2f None admin] PATH_INFO: `/v3/projects/d4e34490401644579c12192562b164b3/users/76ec81b1281c4a0fa168e4d9ae2ad6d0/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:46.535362 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a363b-037b-44d1-a741-60c7a1c02a2f None admin] RBAC: Authorizing `identity:create_grant(project_id=d4e34490401644579c12192562b164b3, user_id=76ec81b1281c4a0fa168e4d9ae2ad6d0, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:46.537700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a363b-037b-44d1-a741-60c7a1c02a2f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:46.555450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 585/1153] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:58:46 2022] PUT /identity/v3/projects/d4e34490401644579c12192562b164b3/users/76ec81b1281c4a0fa168e4d9ae2ad6d0/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:58:48.645494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970c0b4-bd51-4476-be8a-f75e146ef65c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:48.646367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970c0b4-bd51-4476-be8a-f75e146ef65c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:48.646367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970c0b4-bd51-4476-be8a-f75e146ef65c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:48.648521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 569/1154] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:48.655064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f5bf0-1ae4-4ebb-bc55-9ad9362e0011 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:48.655800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f5bf0-1ae4-4ebb-bc55-9ad9362e0011 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:48.655951 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f5bf0-1ae4-4ebb-bc55-9ad9362e0011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:48.682313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c94f5bf0-1ae4-4ebb-bc55-9ad9362e0011 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:48.683520 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c94f5bf0-1ae4-4ebb-bc55-9ad9362e0011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:48.751635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 586/1155] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:49.020843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970c0b4-bd51-4476-be8a-f75e146ef65c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:49.118432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:49.129425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970c0b4-bd51-4476-be8a-f75e146ef65c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:49.164693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65972c-d744-49ca-98d2-6a7f0459a766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:49.165352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65972c-d744-49ca-98d2-6a7f0459a766 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:49.165625 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65972c-d744-49ca-98d2-6a7f0459a766 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:49.165890 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65972c-d744-49ca-98d2-6a7f0459a766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:49.177462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65972c-d744-49ca-98d2-6a7f0459a766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ac65972c-d744-49ca-98d2-6a7f0459a766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:58:49.182167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:49.183224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:58:49.184194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:58:49.185212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 570/1156] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:58:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:49.189543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f5bf0-1ae4-4ebb-bc55-9ad9362e0011 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:49.287321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:49.310721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f5bf0-1ae4-4ebb-bc55-9ad9362e0011 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:49.347624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04f076-eb2f-498e-acf8-f324f2a83586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:49.348567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04f076-eb2f-498e-acf8-f324f2a83586 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:49.348948 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04f076-eb2f-498e-acf8-f324f2a83586 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:49.349333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04f076-eb2f-498e-acf8-f324f2a83586 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:49.350332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04f076-eb2f-498e-acf8-f324f2a83586 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:49.350768 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04f076-eb2f-498e-acf8-f324f2a83586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:49.352969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04f076-eb2f-498e-acf8-f324f2a83586 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:49.365183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 587/1157] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:49.374903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65972c-d744-49ca-98d2-6a7f0459a766 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:49.495995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65972c-d744-49ca-98d2-6a7f0459a766 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:49.532661 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b9af2-91d8-4a62-a315-3be57217ddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:49.533274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b9af2-91d8-4a62-a315-3be57217ddef None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:49.533566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b9af2-91d8-4a62-a315-3be57217ddef None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:49.533842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b9af2-91d8-4a62-a315-3be57217ddef None admin] PATH_INFO: `/v3/users/76ec81b1281c4a0fa168e4d9ae2ad6d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:49.535000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b9af2-91d8-4a62-a315-3be57217ddef None admin] RBAC: Authorizing `identity:get_user(user_id=76ec81b1281c4a0fa168e4d9ae2ad6d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:49.536421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b9af2-91d8-4a62-a315-3be57217ddef None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:49.538074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 571/1158] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:58:49 2022] GET /identity/v3/users/76ec81b1281c4a0fa168e4d9ae2ad6d0 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:49.547375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04f076-eb2f-498e-acf8-f324f2a83586 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:49.654868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04f076-eb2f-498e-acf8-f324f2a83586 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:49.690787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9a17e-68f5-485b-9a53-90768723b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:49.691391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9a17e-68f5-485b-9a53-90768723b55f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:49.691660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9a17e-68f5-485b-9a53-90768723b55f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:49.691977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9a17e-68f5-485b-9a53-90768723b55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:49.702854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:49.759915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9a17e-68f5-485b-9a53-90768723b55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:49.761384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9a17e-68f5-485b-9a53-90768723b55f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:49.870804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 588/1159] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:58:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:58:49.880024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b9af2-91d8-4a62-a315-3be57217ddef None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:49.911554 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:50.007299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b9af2-91d8-4a62-a315-3be57217ddef None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:50.043543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fd2d8-bac1-49b9-97e4-6ad53610fb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:50.044157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd2d8-bac1-49b9-97e4-6ad53610fb44 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:50.044433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd2d8-bac1-49b9-97e4-6ad53610fb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:50.044696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fd2d8-bac1-49b9-97e4-6ad53610fb44 None admin] PATH_INFO: `/v3/projects/d4e34490401644579c12192562b164b3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:50.045849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fd2d8-bac1-49b9-97e4-6ad53610fb44 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e34490401644579c12192562b164b3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:50.047273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fd2d8-bac1-49b9-97e4-6ad53610fb44 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:50.048899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 572/1160] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:58:49 2022] GET /identity/v3/projects/d4e34490401644579c12192562b164b3 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:50.055891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9a17e-68f5-485b-9a53-90768723b55f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:50.109327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:50.168984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9a17e-68f5-485b-9a53-90768723b55f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:50.204206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab114b66-1bfe-4321-9ddc-656679b42e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:50.204798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab114b66-1bfe-4321-9ddc-656679b42e40 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:50.205078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab114b66-1bfe-4321-9ddc-656679b42e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:50.205373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab114b66-1bfe-4321-9ddc-656679b42e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:50.206100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab114b66-1bfe-4321-9ddc-656679b42e40 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=d4e34490401644579c12192562b164b3, user.id=76ec81b1281c4a0fa168e4d9ae2ad6d0) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:50.206408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab114b66-1bfe-4321-9ddc-656679b42e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:50.207938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab114b66-1bfe-4321-9ddc-656679b42e40 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:50.213814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 589/1161] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:58:50 2022] GET /identity/v3/role_assignments?user.id=76ec81b1281c4a0fa168e4d9ae2ad6d0&scope.project.id=d4e34490401644579c12192562b164b3&role.id=77285ef607e34662b6234656fe8043d0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:52.346568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77410b3-e58e-4740-b878-1263ac109296 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:52.347122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77410b3-e58e-4740-b878-1263ac109296 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:52.347122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77410b3-e58e-4740-b878-1263ac109296 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:52.348483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 573/1162] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:52.354915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb677-cb76-411b-84d7-209dff719dcb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:52.355614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb677-cb76-411b-84d7-209dff719dcb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:52.355766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb677-cb76-411b-84d7-209dff719dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:52.381957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4bbcb677-cb76-411b-84d7-209dff719dcb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:52.383863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4bbcb677-cb76-411b-84d7-209dff719dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:52.460159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 590/1163] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:52.721228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77410b3-e58e-4740-b878-1263ac109296 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:52.826494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:52.844327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77410b3-e58e-4740-b878-1263ac109296 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:52.877916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971c3e7-41c7-4c11-bea7-d1eb5c0686f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:52.878511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971c3e7-41c7-4c11-bea7-d1eb5c0686f7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:52.878787 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971c3e7-41c7-4c11-bea7-d1eb5c0686f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:52.879130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971c3e7-41c7-4c11-bea7-d1eb5c0686f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:52.947186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971c3e7-41c7-4c11-bea7-d1eb5c0686f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:52.948626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971c3e7-41c7-4c11-bea7-d1eb5c0686f7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:53.035371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:53.058910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 574/1164] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:58:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:58:53.065254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcb677-cb76-411b-84d7-209dff719dcb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:53.103546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:53.177621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcb677-cb76-411b-84d7-209dff719dcb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:53.214113 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706e719-a3be-495e-90c4-f25098f3a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:53.214737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706e719-a3be-495e-90c4-f25098f3a968 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:53.215016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706e719-a3be-495e-90c4-f25098f3a968 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:53.215287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706e719-a3be-495e-90c4-f25098f3a968 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:53.222532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706e719-a3be-495e-90c4-f25098f3a968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:53.223985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706e719-a3be-495e-90c4-f25098f3a968 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-0706e719-a3be-495e-90c4-f25098f3a968 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:58:53.235838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:58:53.237073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 16:58:53.238191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:58:53.241217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 591/1165] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Sep 19 16:58:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:58:53.243090 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971c3e7-41c7-4c11-bea7-d1eb5c0686f7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:53.354675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971c3e7-41c7-4c11-bea7-d1eb5c0686f7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:53.402185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d08e0c-1589-4836-a7fe-db5bba046834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:53.403070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d08e0c-1589-4836-a7fe-db5bba046834 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:53.403484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d08e0c-1589-4836-a7fe-db5bba046834 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:53.403886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d08e0c-1589-4836-a7fe-db5bba046834 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:53.404869 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d08e0c-1589-4836-a7fe-db5bba046834 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:58:53.405364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d08e0c-1589-4836-a7fe-db5bba046834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:53.407512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d08e0c-1589-4836-a7fe-db5bba046834 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:53.416811 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 575/1166] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Sep 19 16:58:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:55.521757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8032-bbc7-4886-9f96-bee8651b8ddc None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:55.522335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8032-bbc7-4886-9f96-bee8651b8ddc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:55.522335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8032-bbc7-4886-9f96-bee8651b8ddc None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:55.523674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 592/1167] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:55.530073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc60b8-fad0-4940-a737-145f3d93f0a4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:55.530779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc60b8-fad0-4940-a737-145f3d93f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:55.530957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc60b8-fad0-4940-a737-145f3d93f0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:55.558080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-39bc60b8-fad0-4940-a737-145f3d93f0a4 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:55.559274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-39bc60b8-fad0-4940-a737-145f3d93f0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:55.607855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:55.636760 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 576/1168] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:55.906152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8032-bbc7-4886-9f96-bee8651b8ddc None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:56.008004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:56.017052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8032-bbc7-4886-9f96-bee8651b8ddc None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:56.051710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c93515-a53f-4f86-949c-69a459591dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:56.052335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c93515-a53f-4f86-949c-69a459591dd8 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:56.052610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c93515-a53f-4f86-949c-69a459591dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:56.052878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c93515-a53f-4f86-949c-69a459591dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:56.053581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c93515-a53f-4f86-949c-69a459591dd8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:56.054937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c93515-a53f-4f86-949c-69a459591dd8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:56.074139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 593/1169] 10.222.0.76 () {60 vars in 1138 bytes} [Mon Sep 19 16:58:55 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:58:58.194030 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dbe03-409d-4728-be80-2242660ed724 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:58.194536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dbe03-409d-4728-be80-2242660ed724 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:58.194536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dbe03-409d-4728-be80-2242660ed724 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:58.195907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 577/1170] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:58:58.202480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4737-af3b-4035-b4c4-1bb8d2f89068 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:58.203298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4737-af3b-4035-b4c4-1bb8d2f89068 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:58.203426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b4737-af3b-4035-b4c4-1bb8d2f89068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:58.230059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a93b4737-af3b-4035-b4c4-1bb8d2f89068 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:58:58.231293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a93b4737-af3b-4035-b4c4-1bb8d2f89068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:58:58.301537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 594/1171] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:58:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:58:58.580920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dbe03-409d-4728-be80-2242660ed724 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:58.688610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dbe03-409d-4728-be80-2242660ed724 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:58.723363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32015ca6-e5b0-47c5-8ce2-9fd9fe197a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:58.723969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32015ca6-e5b0-47c5-8ce2-9fd9fe197a8e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:58.724245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32015ca6-e5b0-47c5-8ce2-9fd9fe197a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:58.724511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32015ca6-e5b0-47c5-8ce2-9fd9fe197a8e None admin] PATH_INFO: `/v3/domains/2de56b74257648d88d9159afdcae97bb` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:58.735262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32015ca6-e5b0-47c5-8ce2-9fd9fe197a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=2de56b74257648d88d9159afdcae97bb)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:58.736704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32015ca6-e5b0-47c5-8ce2-9fd9fe197a8e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:58.738299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 578/1172] 10.222.0.76 () {56 vars in 1183 bytes} [Mon Sep 19 16:58:58 2022] GET /identity/v3/domains/2de56b74257648d88d9159afdcae97bb => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:58:58.744762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4737-af3b-4035-b4c4-1bb8d2f89068 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:58:58.837675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:58:58.853993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b4737-af3b-4035-b4c4-1bb8d2f89068 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:58:58.890783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86e386-fa31-444d-95e2-8b106fb0c077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:58:58.891395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86e386-fa31-444d-95e2-8b106fb0c077 None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:58:58.891676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86e386-fa31-444d-95e2-8b106fb0c077 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:58:58.891947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86e386-fa31-444d-95e2-8b106fb0c077 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:58:58.892591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86e386-fa31-444d-95e2-8b106fb0c077 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:58:58.894425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86e386-fa31-444d-95e2-8b106fb0c077 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:58:58.924210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 595/1173] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 16:58:58 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:59:01.097874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efc8e1-fea1-4975-b71a-8f286d07a53b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:01.098491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efc8e1-fea1-4975-b71a-8f286d07a53b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:01.098491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efc8e1-fea1-4975-b71a-8f286d07a53b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:01.099796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 579/1174] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:59:01.106397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579e7b-b728-44f9-9976-16cec4cef396 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:01.107245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579e7b-b728-44f9-9976-16cec4cef396 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:01.107245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579e7b-b728-44f9-9976-16cec4cef396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:01.135465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3c579e7b-b728-44f9-9976-16cec4cef396 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:59:01.136929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3c579e7b-b728-44f9-9976-16cec4cef396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:59:01.209705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 596/1175] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:59:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:59:01.475587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efc8e1-fea1-4975-b71a-8f286d07a53b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:01.537567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:01.600392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efc8e1-fea1-4975-b71a-8f286d07a53b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:01.636549 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3634de6-3371-4962-89a6-792fbb3e72a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:01.637212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3634de6-3371-4962-89a6-792fbb3e72a2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:01.637486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3634de6-3371-4962-89a6-792fbb3e72a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:01.637756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3634de6-3371-4962-89a6-792fbb3e72a2 None admin] PATH_INFO: `/v3/domains/2de56b74257648d88d9159afdcae97bb` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:01.638934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3634de6-3371-4962-89a6-792fbb3e72a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2de56b74257648d88d9159afdcae97bb)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:01.640370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3634de6-3371-4962-89a6-792fbb3e72a2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:01.641987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 580/1176] 10.222.0.76 () {56 vars in 1183 bytes} [Mon Sep 19 16:59:01 2022] GET /identity/v3/domains/2de56b74257648d88d9159afdcae97bb => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:01.648598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c579e7b-b728-44f9-9976-16cec4cef396 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:01.717625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:01.756517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c579e7b-b728-44f9-9976-16cec4cef396 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:01.796413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e010f-3d5d-4921-94f7-6e494e8ee0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:01.797049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e010f-3d5d-4921-94f7-6e494e8ee0ec None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:01.797338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e010f-3d5d-4921-94f7-6e494e8ee0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:01.797615 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e010f-3d5d-4921-94f7-6e494e8ee0ec None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:01.798333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e010f-3d5d-4921-94f7-6e494e8ee0ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:01.799791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e010f-3d5d-4921-94f7-6e494e8ee0ec None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:01.828878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 597/1177] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 16:59:01 2022] POST /identity/v3/users => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 16:59:04.021320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694707bf-f1d1-4f84-a9f8-254c9341fd22 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:04.022208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694707bf-f1d1-4f84-a9f8-254c9341fd22 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:04.022208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694707bf-f1d1-4f84-a9f8-254c9341fd22 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:04.024349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 581/1178] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:59:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:59:04.033237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d5225-d935-45ba-9f0b-34c3ffa7ae55 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:04.033658 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d5225-d935-45ba-9f0b-34c3ffa7ae55 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:04.033868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d5225-d935-45ba-9f0b-34c3ffa7ae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:04.054537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-358d5225-d935-45ba-9f0b-34c3ffa7ae55 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:59:04.055749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-358d5225-d935-45ba-9f0b-34c3ffa7ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:59:04.126815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 598/1179] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:59:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:59:04.390794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694707bf-f1d1-4f84-a9f8-254c9341fd22 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:04.511483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694707bf-f1d1-4f84-a9f8-254c9341fd22 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:04.520479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:04.556912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03e544-8e96-4bdc-a0ef-fa81d03fddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:04.557573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03e544-8e96-4bdc-a0ef-fa81d03fddd0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:04.557851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03e544-8e96-4bdc-a0ef-fa81d03fddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:04.558124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03e544-8e96-4bdc-a0ef-fa81d03fddd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:04.574357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03e544-8e96-4bdc-a0ef-fa81d03fddd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5f03e544-8e96-4bdc-a0ef-fa81d03fddd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:59:04.582357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:59:04.583530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:59:04.584575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 582/1180] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:59:04.590767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d5225-d935-45ba-9f0b-34c3ffa7ae55 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:04.655930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:04.703540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d5225-d935-45ba-9f0b-34c3ffa7ae55 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:04.744357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876a924-04f9-42c8-bf20-e7378dc3179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:04.744959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876a924-04f9-42c8-bf20-e7378dc3179f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:04.745276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876a924-04f9-42c8-bf20-e7378dc3179f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:04.745546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876a924-04f9-42c8-bf20-e7378dc3179f None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:04.746214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876a924-04f9-42c8-bf20-e7378dc3179f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:59:04.746516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876a924-04f9-42c8-bf20-e7378dc3179f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:04.747887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876a924-04f9-42c8-bf20-e7378dc3179f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:04.755978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 599/1181] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:04.765636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03e544-8e96-4bdc-a0ef-fa81d03fddd0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:04.887076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03e544-8e96-4bdc-a0ef-fa81d03fddd0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:04.923740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a039555-9708-4601-93d6-ff7ff8ce7fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:04.924290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a039555-9708-4601-93d6-ff7ff8ce7fca None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:04.924578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a039555-9708-4601-93d6-ff7ff8ce7fca None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:04.924843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a039555-9708-4601-93d6-ff7ff8ce7fca None admin] PATH_INFO: `/v3/users/bcade4e5a85c4482973efd62614e1516` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:04.938049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a039555-9708-4601-93d6-ff7ff8ce7fca None admin] RBAC: Authorizing `identity:get_user(user_id=bcade4e5a85c4482973efd62614e1516)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:04.939500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a039555-9708-4601-93d6-ff7ff8ce7fca None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:04.941181 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 583/1182] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:59:04 2022] GET /identity/v3/users/bcade4e5a85c4482973efd62614e1516 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:04.948317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876a924-04f9-42c8-bf20-e7378dc3179f None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:05.050568 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876a924-04f9-42c8-bf20-e7378dc3179f None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:05.064109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:05.086318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedbaae-da20-4cf6-aa83-642da3e3e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:05.086920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedbaae-da20-4cf6-aa83-642da3e3e598 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:05.087196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedbaae-da20-4cf6-aa83-642da3e3e598 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:05.087465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedbaae-da20-4cf6-aa83-642da3e3e598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:05.156539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedbaae-da20-4cf6-aa83-642da3e3e598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:05.158071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedbaae-da20-4cf6-aa83-642da3e3e598 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:05.261827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 600/1183] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:59:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:59:05.268639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a039555-9708-4601-93d6-ff7ff8ce7fca None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:05.297010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:05.384018 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a039555-9708-4601-93d6-ff7ff8ce7fca None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:05.420081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c44710-0662-434e-89af-e370aba016bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:05.420701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44710-0662-434e-89af-e370aba016bc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:05.420980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44710-0662-434e-89af-e370aba016bc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:05.421287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c44710-0662-434e-89af-e370aba016bc None admin] PATH_INFO: `/v3/projects/b237cd4f5e12427090e65d150ab6659d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:05.422538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c44710-0662-434e-89af-e370aba016bc None admin] RBAC: Authorizing `identity:get_project(project_id=b237cd4f5e12427090e65d150ab6659d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:05.423980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c44710-0662-434e-89af-e370aba016bc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:05.425640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 584/1184] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:59:05 2022] GET /identity/v3/projects/b237cd4f5e12427090e65d150ab6659d => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:05.432188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedbaae-da20-4cf6-aa83-642da3e3e598 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:05.448183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:05.545086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedbaae-da20-4cf6-aa83-642da3e3e598 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:05.579999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4a234-401d-4d58-b5ef-615baf99cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:05.580599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a234-401d-4d58-b5ef-615baf99cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:05.580877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a234-401d-4d58-b5ef-615baf99cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:05.581174 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4a234-401d-4d58-b5ef-615baf99cbd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:05.581895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4a234-401d-4d58-b5ef-615baf99cbd3 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=b237cd4f5e12427090e65d150ab6659d, user.id=bcade4e5a85c4482973efd62614e1516) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:59:05.582313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4a234-401d-4d58-b5ef-615baf99cbd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:05.583760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4a234-401d-4d58-b5ef-615baf99cbd3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:05.589255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 601/1185] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:59:05 2022] GET /identity/v3/role_assignments?user.id=bcade4e5a85c4482973efd62614e1516&scope.project.id=b237cd4f5e12427090e65d150ab6659d&role.id=77285ef607e34662b6234656fe8043d0 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:07.683196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b952f5d-63b6-43d9-a37b-ac7062b80b70 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:07.684094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b952f5d-63b6-43d9-a37b-ac7062b80b70 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:07.684094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b952f5d-63b6-43d9-a37b-ac7062b80b70 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:07.686287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 585/1186] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:59:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:59:07.691789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0d582-6471-4981-a977-7a8c9ba03f72 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:07.692237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0d582-6471-4981-a977-7a8c9ba03f72 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:07.692345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0d582-6471-4981-a977-7a8c9ba03f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:07.712060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-82f0d582-6471-4981-a977-7a8c9ba03f72 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:59:07.713271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-82f0d582-6471-4981-a977-7a8c9ba03f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:59:07.782301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 602/1187] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:59:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 16:59:08.047344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b952f5d-63b6-43d9-a37b-ac7062b80b70 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:08.155396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:08.165259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b952f5d-63b6-43d9-a37b-ac7062b80b70 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:08.201888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace359b-8c5d-4af4-917c-5c31bfa6ebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:08.202516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace359b-8c5d-4af4-917c-5c31bfa6ebbf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:08.202796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace359b-8c5d-4af4-917c-5c31bfa6ebbf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:08.203066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace359b-8c5d-4af4-917c-5c31bfa6ebbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:08.214253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace359b-8c5d-4af4-917c-5c31bfa6ebbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5ace359b-8c5d-4af4-917c-5c31bfa6ebbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:59:08.219069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:59:08.220179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 16:59:08.221063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 586/1188] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:59:08.229084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0d582-6471-4981-a977-7a8c9ba03f72 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:08.242896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:08.336780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0d582-6471-4981-a977-7a8c9ba03f72 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:08.372079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a638b-645c-46f4-ac05-92acad7c531e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:08.372662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a638b-645c-46f4-ac05-92acad7c531e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:08.372938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a638b-645c-46f4-ac05-92acad7c531e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:08.373236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a638b-645c-46f4-ac05-92acad7c531e None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:08.373891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a638b-645c-46f4-ac05-92acad7c531e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:59:08.374189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a638b-645c-46f4-ac05-92acad7c531e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:08.375549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a638b-645c-46f4-ac05-92acad7c531e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:08.383613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 603/1189] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:08.391129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace359b-8c5d-4af4-917c-5c31bfa6ebbf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:08.498565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace359b-8c5d-4af4-917c-5c31bfa6ebbf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:08.536327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52c60f-e3bb-4f07-a34a-4157df68e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:08.536946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c60f-e3bb-4f07-a34a-4157df68e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:08.537258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c60f-e3bb-4f07-a34a-4157df68e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:08.537527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c60f-e3bb-4f07-a34a-4157df68e9c7 None admin] PATH_INFO: `/v3/users/bcade4e5a85c4482973efd62614e1516` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:08.538698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52c60f-e3bb-4f07-a34a-4157df68e9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=bcade4e5a85c4482973efd62614e1516)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:08.540129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52c60f-e3bb-4f07-a34a-4157df68e9c7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:08.541738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 587/1190] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:59:08 2022] GET /identity/v3/users/bcade4e5a85c4482973efd62614e1516 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:08.550908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a638b-645c-46f4-ac05-92acad7c531e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:08.630289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:08.662731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a638b-645c-46f4-ac05-92acad7c531e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:08.697414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab562bf-70e4-4eef-86e3-101f7f400f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:08.698011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab562bf-70e4-4eef-86e3-101f7f400f4d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:08.698306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab562bf-70e4-4eef-86e3-101f7f400f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:08.698580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab562bf-70e4-4eef-86e3-101f7f400f4d None admin] PATH_INFO: `/v3/projects/b237cd4f5e12427090e65d150ab6659d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:08.699823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab562bf-70e4-4eef-86e3-101f7f400f4d None admin] RBAC: Authorizing `identity:get_project(project_id=b237cd4f5e12427090e65d150ab6659d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:08.701318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab562bf-70e4-4eef-86e3-101f7f400f4d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:08.702939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 604/1191] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:59:08 2022] GET /identity/v3/projects/b237cd4f5e12427090e65d150ab6659d => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:08.709599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52c60f-e3bb-4f07-a34a-4157df68e9c7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:08.742304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:08.822139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52c60f-e3bb-4f07-a34a-4157df68e9c7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:08.859092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac74384-df58-4f15-9c18-3702bc9f6526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:08.859741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac74384-df58-4f15-9c18-3702bc9f6526 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:08.860014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac74384-df58-4f15-9c18-3702bc9f6526 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:08.860279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac74384-df58-4f15-9c18-3702bc9f6526 None admin] PATH_INFO: `/v3/projects/b237cd4f5e12427090e65d150ab6659d/users/bcade4e5a85c4482973efd62614e1516/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:08.862492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac74384-df58-4f15-9c18-3702bc9f6526 None admin] RBAC: Authorizing `identity:create_grant(project_id=b237cd4f5e12427090e65d150ab6659d, user_id=bcade4e5a85c4482973efd62614e1516, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:08.863977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac74384-df58-4f15-9c18-3702bc9f6526 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:08.879546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 588/1192] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 16:59:08 2022] PUT /identity/v3/projects/b237cd4f5e12427090e65d150ab6659d/users/bcade4e5a85c4482973efd62614e1516/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 16:59:10.993458 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ed7d-5378-4bdb-96f5-64335fd23143 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:10.994347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ed7d-5378-4bdb-96f5-64335fd23143 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:10.994347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5ed7d-5378-4bdb-96f5-64335fd23143 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:10.996417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 605/1193] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 16:59:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 16:59:11.004864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090fb9-6d34-4ae2-9900-4ab819ed7cc0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:11.005357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090fb9-6d34-4ae2-9900-4ab819ed7cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:11.005666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090fb9-6d34-4ae2-9900-4ab819ed7cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:11.026159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-72090fb9-6d34-4ae2-9900-4ab819ed7cc0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 16:59:11.027338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-72090fb9-6d34-4ae2-9900-4ab819ed7cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 16:59:11.100407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 589/1194] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 16:59:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 16:59:11.370982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5ed7d-5378-4bdb-96f5-64335fd23143 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:11.480667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5ed7d-5378-4bdb-96f5-64335fd23143 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:11.515685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a1148-00e8-4633-b524-7489b514509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:11.516304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a1148-00e8-4633-b524-7489b514509b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:11.516582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a1148-00e8-4633-b524-7489b514509b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:11.516854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a1148-00e8-4633-b524-7489b514509b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:11.524693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:11.531823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a1148-00e8-4633-b524-7489b514509b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-945a1148-00e8-4633-b524-7489b514509b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 16:59:11.538355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 16:59:11.539387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 16:59:11.540366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 606/1195] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 16:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 16:59:11.545790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090fb9-6d34-4ae2-9900-4ab819ed7cc0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:11.560567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:11.661452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090fb9-6d34-4ae2-9900-4ab819ed7cc0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:11.696313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea271f-4b87-43f3-bd97-943dec3fd3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:11.696906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea271f-4b87-43f3-bd97-943dec3fd3af None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:11.697207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea271f-4b87-43f3-bd97-943dec3fd3af None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:11.697488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea271f-4b87-43f3-bd97-943dec3fd3af None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:11.698153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea271f-4b87-43f3-bd97-943dec3fd3af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:59:11.698460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea271f-4b87-43f3-bd97-943dec3fd3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:11.699867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea271f-4b87-43f3-bd97-943dec3fd3af None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:11.707930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 590/1196] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 16:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:11.716741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a1148-00e8-4633-b524-7489b514509b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:11.818920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a1148-00e8-4633-b524-7489b514509b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:11.853313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc489e-4f00-4482-a8e7-af207f9afae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:11.853921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc489e-4f00-4482-a8e7-af207f9afae3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:11.854197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc489e-4f00-4482-a8e7-af207f9afae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:11.854473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc489e-4f00-4482-a8e7-af207f9afae3 None admin] PATH_INFO: `/v3/users/bcade4e5a85c4482973efd62614e1516` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:11.855720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc489e-4f00-4482-a8e7-af207f9afae3 None admin] RBAC: Authorizing `identity:get_user(user_id=bcade4e5a85c4482973efd62614e1516)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:11.857169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc489e-4f00-4482-a8e7-af207f9afae3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:11.858733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 607/1197] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Sep 19 16:59:11 2022] GET /identity/v3/users/bcade4e5a85c4482973efd62614e1516 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 16:59:11.866359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea271f-4b87-43f3-bd97-943dec3fd3af None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:11.958395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:11.996502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea271f-4b87-43f3-bd97-943dec3fd3af None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:12.034571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0986f-666d-4f8b-aa90-b4462d1a1aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:12.035201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0986f-666d-4f8b-aa90-b4462d1a1aca None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:12.035433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0986f-666d-4f8b-aa90-b4462d1a1aca None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:12.035707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0986f-666d-4f8b-aa90-b4462d1a1aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:12.103726 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0986f-666d-4f8b-aa90-b4462d1a1aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:12.105192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0986f-666d-4f8b-aa90-b4462d1a1aca None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:12.180604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:12.206752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 591/1198] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 16:59:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 16:59:12.213119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc489e-4f00-4482-a8e7-af207f9afae3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:12.278897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:12.313870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc489e-4f00-4482-a8e7-af207f9afae3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:12.348724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9ba29-f344-4822-8188-6f550e09c138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:12.349373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9ba29-f344-4822-8188-6f550e09c138 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:12.349652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9ba29-f344-4822-8188-6f550e09c138 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:12.349922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9ba29-f344-4822-8188-6f550e09c138 None admin] PATH_INFO: `/v3/projects/b237cd4f5e12427090e65d150ab6659d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:12.351095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9ba29-f344-4822-8188-6f550e09c138 None admin] RBAC: Authorizing `identity:get_project(project_id=b237cd4f5e12427090e65d150ab6659d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:12.352526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9ba29-f344-4822-8188-6f550e09c138 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:12.354166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 608/1199] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Sep 19 16:59:12 2022] GET /identity/v3/projects/b237cd4f5e12427090e65d150ab6659d => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:12.363369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0986f-666d-4f8b-aa90-b4462d1a1aca None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 16:59:12.466065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0986f-666d-4f8b-aa90-b4462d1a1aca None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 16:59:12.502595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6850532-b092-4eb7-b010-5415321a39ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 16:59:12.503203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850532-b092-4eb7-b010-5415321a39ad None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 16:59:12.503491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850532-b092-4eb7-b010-5415321a39ad None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 16:59:12.503762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6850532-b092-4eb7-b010-5415321a39ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 16:59:12.504497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6850532-b092-4eb7-b010-5415321a39ad None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=b237cd4f5e12427090e65d150ab6659d, user.id=bcade4e5a85c4482973efd62614e1516) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 16:59:12.504804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6850532-b092-4eb7-b010-5415321a39ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 16:59:12.506278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6850532-b092-4eb7-b010-5415321a39ad None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 16:59:12.512028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 592/1200] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 16:59:12 2022] GET /identity/v3/role_assignments?user.id=bcade4e5a85c4482973efd62614e1516&scope.project.id=b237cd4f5e12427090e65d150ab6659d&role.id=77285ef607e34662b6234656fe8043d0 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 16:59:22.343404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=33 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 16:59:22.509464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=81 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:07.812689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768c153-e9d3-41ee-9c83-e42362e7ec5f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:07.813665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768c153-e9d3-41ee-9c83-e42362e7ec5f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:07.813665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768c153-e9d3-41ee-9c83-e42362e7ec5f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:07.814816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 609/1201] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:07.820233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f4760-2a8e-4c86-a9e6-156bbfedca4d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:07.820878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f4760-2a8e-4c86-a9e6-156bbfedca4d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:07.820878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f4760-2a8e-4c86-a9e6-156bbfedca4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:07.845723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-849f4760-2a8e-4c86-a9e6-156bbfedca4d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:07.847270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-849f4760-2a8e-4c86-a9e6-156bbfedca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:07.945856 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 593/1202] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 17:00:08.211117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768c153-e9d3-41ee-9c83-e42362e7ec5f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:08.350034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768c153-e9d3-41ee-9c83-e42362e7ec5f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:08.398931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2b8b4-cf24-4ba4-a43b-830c8cb29048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:08.400001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b8b4-cf24-4ba4-a43b-830c8cb29048 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:08.400504 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b8b4-cf24-4ba4-a43b-830c8cb29048 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:08.400961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2b8b4-cf24-4ba4-a43b-830c8cb29048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:08.413807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2b8b4-cf24-4ba4-a43b-830c8cb29048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:08.415358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2b8b4-cf24-4ba4-a43b-830c8cb29048 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-c2d2b8b4-cf24-4ba4-a43b-830c8cb29048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:08.430716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:08.431809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:08.432787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:08.432787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:08.432787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:08.432787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 610/1203] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:08.438112 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f4760-2a8e-4c86-a9e6-156bbfedca4d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:08.555211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f4760-2a8e-4c86-a9e6-156bbfedca4d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:08.587809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:08.596018 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec8d91-b41f-4290-9d20-4951ab20e941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:08.596763 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec8d91-b41f-4290-9d20-4951ab20e941 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:08.597107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec8d91-b41f-4290-9d20-4951ab20e941 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:08.597387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec8d91-b41f-4290-9d20-4951ab20e941 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:08.598047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec8d91-b41f-4290-9d20-4951ab20e941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:08.598350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec8d91-b41f-4290-9d20-4951ab20e941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:08.599932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec8d91-b41f-4290-9d20-4951ab20e941 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:08.616175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 594/1204] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:08.622317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2b8b4-cf24-4ba4-a43b-830c8cb29048 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:08.696385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:08.750103 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2b8b4-cf24-4ba4-a43b-830c8cb29048 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:08.794253 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a829a6-0054-4fd6-98f3-c32a79e0e31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:08.795000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a829a6-0054-4fd6-98f3-c32a79e0e31b None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:08.795305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a829a6-0054-4fd6-98f3-c32a79e0e31b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:08.795624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a829a6-0054-4fd6-98f3-c32a79e0e31b None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:08.796451 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a829a6-0054-4fd6-98f3-c32a79e0e31b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:08.798216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a829a6-0054-4fd6-98f3-c32a79e0e31b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:08.827747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 611/1205] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Sep 19 17:00:08 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:00:11.059303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdf6a-5a67-4306-95aa-e5379f8690e6 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:11.059870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdf6a-5a67-4306-95aa-e5379f8690e6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:11.059870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdf6a-5a67-4306-95aa-e5379f8690e6 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:11.061232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 595/1206] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:11.066741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e37e9-627d-4d0e-83db-c06c335f81b6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:11.067250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e37e9-627d-4d0e-83db-c06c335f81b6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:11.067358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e37e9-627d-4d0e-83db-c06c335f81b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:11.088343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7d2e37e9-627d-4d0e-83db-c06c335f81b6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:11.089797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7d2e37e9-627d-4d0e-83db-c06c335f81b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:11.175911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 612/1207] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 17:00:11.481556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbdf6a-5a67-4306-95aa-e5379f8690e6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:11.604830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbdf6a-5a67-4306-95aa-e5379f8690e6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:11.640154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a110f8-5f69-4c33-94bb-7c4417ddcaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:11.640768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a110f8-5f69-4c33-94bb-7c4417ddcaed None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:11.641068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a110f8-5f69-4c33-94bb-7c4417ddcaed None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:11.641348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a110f8-5f69-4c33-94bb-7c4417ddcaed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:11.652914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a110f8-5f69-4c33-94bb-7c4417ddcaed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-62a110f8-5f69-4c33-94bb-7c4417ddcaed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 17:00:11.657700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:11.659211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:11.660068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 596/1208] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 17:00:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:11.668380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e37e9-627d-4d0e-83db-c06c335f81b6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:11.713259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:11.782934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e37e9-627d-4d0e-83db-c06c335f81b6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:11.821317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598f412-b39d-4bf9-91cc-0fc3d7b78740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:11.821995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598f412-b39d-4bf9-91cc-0fc3d7b78740 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:11.822293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598f412-b39d-4bf9-91cc-0fc3d7b78740 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:11.822645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598f412-b39d-4bf9-91cc-0fc3d7b78740 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:11.823440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598f412-b39d-4bf9-91cc-0fc3d7b78740 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:11.823770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598f412-b39d-4bf9-91cc-0fc3d7b78740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:11.825544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598f412-b39d-4bf9-91cc-0fc3d7b78740 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:11.835492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 613/1209] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 17:00:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:11.841202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a110f8-5f69-4c33-94bb-7c4417ddcaed None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:11.910738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:11.976566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a110f8-5f69-4c33-94bb-7c4417ddcaed None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:12.015542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87615b1c-d0a2-4455-a4b0-2011bceebe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:12.017065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87615b1c-d0a2-4455-a4b0-2011bceebe42 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:12.017065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87615b1c-d0a2-4455-a4b0-2011bceebe42 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:12.017306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87615b1c-d0a2-4455-a4b0-2011bceebe42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:12.029759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87615b1c-d0a2-4455-a4b0-2011bceebe42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:12.031421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87615b1c-d0a2-4455-a4b0-2011bceebe42 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-87615b1c-d0a2-4455-a4b0-2011bceebe42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:12.048924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:12.050377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:12.051272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:12.051272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:12.051272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:12.051272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 597/1210] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 17:00:12.056459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598f412-b39d-4bf9-91cc-0fc3d7b78740 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:12.171600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:12.175569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598f412-b39d-4bf9-91cc-0fc3d7b78740 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:12.214832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e3cb-249c-4412-87ce-98c989aca3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:12.215443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e3cb-249c-4412-87ce-98c989aca3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:12.215721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e3cb-249c-4412-87ce-98c989aca3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:12.215991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133e3cb-249c-4412-87ce-98c989aca3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:12.216635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e3cb-249c-4412-87ce-98c989aca3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:12.216952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e3cb-249c-4412-87ce-98c989aca3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:12.218333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133e3cb-249c-4412-87ce-98c989aca3a7 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:12.231165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 614/1211] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:12.236984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87615b1c-d0a2-4455-a4b0-2011bceebe42 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:12.364113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87615b1c-d0a2-4455-a4b0-2011bceebe42 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:12.365965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:12.410901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f647b89-1d90-47a2-b283-f79c08b504fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:12.411722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f647b89-1d90-47a2-b283-f79c08b504fb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:12.412002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f647b89-1d90-47a2-b283-f79c08b504fb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:12.412265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f647b89-1d90-47a2-b283-f79c08b504fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:12.422111 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f647b89-1d90-47a2-b283-f79c08b504fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:12.423589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f647b89-1d90-47a2-b283-f79c08b504fb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8f647b89-1d90-47a2-b283-f79c08b504fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 17:00:12.438410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:12.439620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:12.440681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 598/1212] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:12.445597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e3cb-249c-4412-87ce-98c989aca3a7 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:12.552863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133e3cb-249c-4412-87ce-98c989aca3a7 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:12.590445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6e7a1-6db4-4e1b-bc2c-dd3a7785b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:12.591050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6e7a1-6db4-4e1b-bc2c-dd3a7785b304 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:12.591332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6e7a1-6db4-4e1b-bc2c-dd3a7785b304 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:12.591606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6e7a1-6db4-4e1b-bc2c-dd3a7785b304 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:12.592343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6e7a1-6db4-4e1b-bc2c-dd3a7785b304 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:12.592648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6e7a1-6db4-4e1b-bc2c-dd3a7785b304 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:12.594127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6e7a1-6db4-4e1b-bc2c-dd3a7785b304 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:12.613132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 615/1213] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Sep 19 17:00:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:12.618882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f647b89-1d90-47a2-b283-f79c08b504fb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:12.733871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f647b89-1d90-47a2-b283-f79c08b504fb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:12.774530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4877a-2f54-4dc9-9dcc-72816864c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:12.775420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4877a-2f54-4dc9-9dcc-72816864c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:12.775745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4877a-2f54-4dc9-9dcc-72816864c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:12.776086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4877a-2f54-4dc9-9dcc-72816864c4c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:12.810606 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:12.858730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4877a-2f54-4dc9-9dcc-72816864c4c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:12.861018 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4877a-2f54-4dc9-9dcc-72816864c4c1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:12.982024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 599/1214] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 17:00:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 17:00:12.988544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6e7a1-6db4-4e1b-bc2c-dd3a7785b304 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:13.008175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:13.102216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6e7a1-6db4-4e1b-bc2c-dd3a7785b304 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:13.140807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47c4a7-241e-4697-a312-667102e1c8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:13.141874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c4a7-241e-4697-a312-667102e1c8ce None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:13.142153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c4a7-241e-4697-a312-667102e1c8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:13.142423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c4a7-241e-4697-a312-667102e1c8ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:13.156162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47c4a7-241e-4697-a312-667102e1c8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:13.157758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47c4a7-241e-4697-a312-667102e1c8ce None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-5e47c4a7-241e-4697-a312-667102e1c8ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:13.173325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:13.175152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:13.176336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:13.176336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:13.176336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:13.176336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 616/1215] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:13.180510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4877a-2f54-4dc9-9dcc-72816864c4c1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:13.243814 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:13.292098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4877a-2f54-4dc9-9dcc-72816864c4c1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:13.330531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944a548-11d3-4b12-a894-ef4f03e913e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:13.331254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944a548-11d3-4b12-a894-ef4f03e913e1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:13.331671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944a548-11d3-4b12-a894-ef4f03e913e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:13.331948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944a548-11d3-4b12-a894-ef4f03e913e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:13.332642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944a548-11d3-4b12-a894-ef4f03e913e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:13.332972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944a548-11d3-4b12-a894-ef4f03e913e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:13.334523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944a548-11d3-4b12-a894-ef4f03e913e1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:13.348128 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 600/1216] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:13.354209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47c4a7-241e-4697-a312-667102e1c8ce None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:13.432129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:13.469798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47c4a7-241e-4697-a312-667102e1c8ce None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:13.523804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef831204-5c80-489b-95e9-186e8a14a03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:13.524235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef831204-5c80-489b-95e9-186e8a14a03e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:13.525249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef831204-5c80-489b-95e9-186e8a14a03e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:13.525249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef831204-5c80-489b-95e9-186e8a14a03e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:13.534301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef831204-5c80-489b-95e9-186e8a14a03e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:13.535778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef831204-5c80-489b-95e9-186e8a14a03e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ef831204-5c80-489b-95e9-186e8a14a03e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 17:00:13.553350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:13.554454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:13.557775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 17:00:13.557775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 17:00:13.557775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 17:00:13.557775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 17:00:13.557775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 17:00:13.557775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 17:00:13.557775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:13.557775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:13.557775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 617/1217] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 17:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:13.561193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944a548-11d3-4b12-a894-ef4f03e913e1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:13.667302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944a548-11d3-4b12-a894-ef4f03e913e1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:13.690753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:13.703917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1667be-45dd-4095-bd3b-57611af04750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:13.704539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1667be-45dd-4095-bd3b-57611af04750 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:13.704811 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1667be-45dd-4095-bd3b-57611af04750 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:13.705109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1667be-45dd-4095-bd3b-57611af04750 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:13.705843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1667be-45dd-4095-bd3b-57611af04750 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:13.706135 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1667be-45dd-4095-bd3b-57611af04750 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:13.707570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1667be-45dd-4095-bd3b-57611af04750 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:13.720434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 601/1218] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 17:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:13.726845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef831204-5c80-489b-95e9-186e8a14a03e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:13.841783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef831204-5c80-489b-95e9-186e8a14a03e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:13.875546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:13.883125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f678d9-86ff-4924-a404-03a3ecda24d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:13.883775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f678d9-86ff-4924-a404-03a3ecda24d8 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:13.884053 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f678d9-86ff-4924-a404-03a3ecda24d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:13.884322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f678d9-86ff-4924-a404-03a3ecda24d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:13.885075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f678d9-86ff-4924-a404-03a3ecda24d8 None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=4716f9539151414dadd9e4b8f13ffc0b) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:13.885381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f678d9-86ff-4924-a404-03a3ecda24d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:13.886804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f678d9-86ff-4924-a404-03a3ecda24d8 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:13.893313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 618/1219] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 17:00:13 2022] GET /identity/v3/role_assignments?user.id=4716f9539151414dadd9e4b8f13ffc0b&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:16.205395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff3e7d-3329-45ca-aeea-30d51cd65116 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:16.206028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff3e7d-3329-45ca-aeea-30d51cd65116 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:16.206028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff3e7d-3329-45ca-aeea-30d51cd65116 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:16.207357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 602/1220] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:16.212783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c20d-4a30-4f2b-9b07-43983936d991 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:16.213266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c20d-4a30-4f2b-9b07-43983936d991 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:16.213366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c20d-4a30-4f2b-9b07-43983936d991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:16.232736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-39d1c20d-4a30-4f2b-9b07-43983936d991 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:16.234032 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-39d1c20d-4a30-4f2b-9b07-43983936d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:16.318175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 619/1221] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 17:00:16.598351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff3e7d-3329-45ca-aeea-30d51cd65116 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:16.706499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff3e7d-3329-45ca-aeea-30d51cd65116 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:16.744458 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fcc9c-bcb2-48c7-8c1d-afa5c3a67868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:16.745121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fcc9c-bcb2-48c7-8c1d-afa5c3a67868 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:16.745402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fcc9c-bcb2-48c7-8c1d-afa5c3a67868 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:16.745676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fcc9c-bcb2-48c7-8c1d-afa5c3a67868 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:16.756166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fcc9c-bcb2-48c7-8c1d-afa5c3a67868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a44fcc9c-bcb2-48c7-8c1d-afa5c3a67868 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 17:00:16.761161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:16.762377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:16.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 603/1222] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 17:00:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:16.768801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1c20d-4a30-4f2b-9b07-43983936d991 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:16.883439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1c20d-4a30-4f2b-9b07-43983936d991 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:16.911501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:16.923948 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da5159-c46a-4d7c-924f-3b2c5fe95ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:16.924681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da5159-c46a-4d7c-924f-3b2c5fe95ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:16.924994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da5159-c46a-4d7c-924f-3b2c5fe95ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:16.925401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da5159-c46a-4d7c-924f-3b2c5fe95ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:16.926078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da5159-c46a-4d7c-924f-3b2c5fe95ef5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:16.926367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da5159-c46a-4d7c-924f-3b2c5fe95ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:16.927917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da5159-c46a-4d7c-924f-3b2c5fe95ef5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:16.936737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 620/1223] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 17:00:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:16.942980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fcc9c-bcb2-48c7-8c1d-afa5c3a67868 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:16.993708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:17.065692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fcc9c-bcb2-48c7-8c1d-afa5c3a67868 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:17.110997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48143fc0-16dd-459f-a3fe-c78dea06b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:17.111895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48143fc0-16dd-459f-a3fe-c78dea06b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:17.112332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48143fc0-16dd-459f-a3fe-c78dea06b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:17.112594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48143fc0-16dd-459f-a3fe-c78dea06b1f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:17.125006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48143fc0-16dd-459f-a3fe-c78dea06b1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:17.126654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48143fc0-16dd-459f-a3fe-c78dea06b1f9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-48143fc0-16dd-459f-a3fe-c78dea06b1f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:17.142896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:17.143977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:17.144874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:17.144874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:17.144874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:17.144874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 604/1224] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:17.150568 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da5159-c46a-4d7c-924f-3b2c5fe95ef5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:17.259370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da5159-c46a-4d7c-924f-3b2c5fe95ef5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:17.297462 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ea87-b46a-4599-8ec4-ccff7e898900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:17.298148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ea87-b46a-4599-8ec4-ccff7e898900 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:17.298456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ea87-b46a-4599-8ec4-ccff7e898900 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:17.298799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ea87-b46a-4599-8ec4-ccff7e898900 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:17.299553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0ea87-b46a-4599-8ec4-ccff7e898900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:17.299887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0ea87-b46a-4599-8ec4-ccff7e898900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:17.301607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0ea87-b46a-4599-8ec4-ccff7e898900 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:17.315214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 621/1225] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:17.321834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48143fc0-16dd-459f-a3fe-c78dea06b1f9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:17.424467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:17.431942 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48143fc0-16dd-459f-a3fe-c78dea06b1f9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:17.467221 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649533a9-b74d-40e5-96ad-0619cae5f8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:17.467899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649533a9-b74d-40e5-96ad-0619cae5f8ac None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:17.468179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649533a9-b74d-40e5-96ad-0619cae5f8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:17.468453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649533a9-b74d-40e5-96ad-0619cae5f8ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:17.476270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649533a9-b74d-40e5-96ad-0619cae5f8ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:17.477831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649533a9-b74d-40e5-96ad-0619cae5f8ac None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-649533a9-b74d-40e5-96ad-0619cae5f8ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 17:00:17.489482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:17.490711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:17.492031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 605/1226] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:17.496911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ea87-b46a-4599-8ec4-ccff7e898900 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:17.560836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:17.627622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ea87-b46a-4599-8ec4-ccff7e898900 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:17.667879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df69e5-3ac7-41dc-b78a-083f75816ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:17.668496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df69e5-3ac7-41dc-b78a-083f75816ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:17.668801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df69e5-3ac7-41dc-b78a-083f75816ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:17.669107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df69e5-3ac7-41dc-b78a-083f75816ff5 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:17.669975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df69e5-3ac7-41dc-b78a-083f75816ff5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:17.670259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df69e5-3ac7-41dc-b78a-083f75816ff5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:17.671839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df69e5-3ac7-41dc-b78a-083f75816ff5 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:17.690827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 622/1227] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Sep 19 17:00:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:17.696978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649533a9-b74d-40e5-96ad-0619cae5f8ac None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:17.806725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649533a9-b74d-40e5-96ad-0619cae5f8ac None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:17.843644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc73e22-92d4-49a8-9070-d6f6a754f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:17.844350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc73e22-92d4-49a8-9070-d6f6a754f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:17.844624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc73e22-92d4-49a8-9070-d6f6a754f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:17.845165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc73e22-92d4-49a8-9070-d6f6a754f8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:17.857644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc73e22-92d4-49a8-9070-d6f6a754f8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:17.859191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc73e22-92d4-49a8-9070-d6f6a754f8d3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9fc73e22-92d4-49a8-9070-d6f6a754f8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:17.876754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:17.878158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:17.879453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:17.879453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:17.879453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:17.879453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 606/1228] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:17.885658 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df69e5-3ac7-41dc-b78a-083f75816ff5 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:18.001261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df69e5-3ac7-41dc-b78a-083f75816ff5 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:18.003663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:18.039966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3fea7-fadf-4804-8956-40699f37dc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:18.040586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3fea7-fadf-4804-8956-40699f37dc8b None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:18.040945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3fea7-fadf-4804-8956-40699f37dc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:18.041317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3fea7-fadf-4804-8956-40699f37dc8b None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:18.042077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3fea7-fadf-4804-8956-40699f37dc8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:18.042427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3fea7-fadf-4804-8956-40699f37dc8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:18.044530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3fea7-fadf-4804-8956-40699f37dc8b None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:18.057344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 623/1229] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:18.063125 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc73e22-92d4-49a8-9070-d6f6a754f8d3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:18.072533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:18.173217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc73e22-92d4-49a8-9070-d6f6a754f8d3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:18.207775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827be036-1194-4dd1-956c-64873a2da600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:18.208409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827be036-1194-4dd1-956c-64873a2da600 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:18.208685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827be036-1194-4dd1-956c-64873a2da600 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:18.208954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827be036-1194-4dd1-956c-64873a2da600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:18.215683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827be036-1194-4dd1-956c-64873a2da600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:18.217169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827be036-1194-4dd1-956c-64873a2da600 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-827be036-1194-4dd1-956c-64873a2da600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 17:00:18.228796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:18.229864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:18.236024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 17:00:18.236024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 17:00:18.236024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 17:00:18.236024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 17:00:18.236024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 17:00:18.236024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 17:00:18.236024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:18.236024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:18.236024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 607/1230] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 17:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:18.236597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3fea7-fadf-4804-8956-40699f37dc8b None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:18.341762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3fea7-fadf-4804-8956-40699f37dc8b None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:18.375406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f475947-2ecd-4aec-95f6-6097fe69d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:18.375968 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f475947-2ecd-4aec-95f6-6097fe69d421 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:18.376245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f475947-2ecd-4aec-95f6-6097fe69d421 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:18.376517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f475947-2ecd-4aec-95f6-6097fe69d421 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:18.377251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f475947-2ecd-4aec-95f6-6097fe69d421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:18.377609 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f475947-2ecd-4aec-95f6-6097fe69d421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:18.379110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f475947-2ecd-4aec-95f6-6097fe69d421 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:18.398355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 624/1231] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 17:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:18.400039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827be036-1194-4dd1-956c-64873a2da600 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:18.467834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:18.511069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827be036-1194-4dd1-956c-64873a2da600 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:18.551378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e141618-3bb2-4841-8435-d2aefa1d93d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:18.552068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e141618-3bb2-4841-8435-d2aefa1d93d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:18.552376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e141618-3bb2-4841-8435-d2aefa1d93d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:18.552677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e141618-3bb2-4841-8435-d2aefa1d93d8 None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/4716f9539151414dadd9e4b8f13ffc0b/roles/0af1ff2cf6f948529ec7cece6eca90d4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:18.569800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e141618-3bb2-4841-8435-d2aefa1d93d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=4716f9539151414dadd9e4b8f13ffc0b, role_id=0af1ff2cf6f948529ec7cece6eca90d4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:18.571253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e141618-3bb2-4841-8435-d2aefa1d93d8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:18.584498 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 608/1232] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 17:00:18 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/4716f9539151414dadd9e4b8f13ffc0b/roles/0af1ff2cf6f948529ec7cece6eca90d4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:00:20.848360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3e634-2f57-4b65-a5bb-7429958c556a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:20.848927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3e634-2f57-4b65-a5bb-7429958c556a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:20.848927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3e634-2f57-4b65-a5bb-7429958c556a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:20.850506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 625/1233] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:20.857111 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181efee-f9ca-4b40-bcc5-bd631866cb3e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:20.857766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181efee-f9ca-4b40-bcc5-bd631866cb3e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:20.857766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181efee-f9ca-4b40-bcc5-bd631866cb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:20.879650 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f181efee-f9ca-4b40-bcc5-bd631866cb3e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:20.881009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f181efee-f9ca-4b40-bcc5-bd631866cb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:20.955786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 609/1234] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 17:00:21.244883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3e634-2f57-4b65-a5bb-7429958c556a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:21.274081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:21.358158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3e634-2f57-4b65-a5bb-7429958c556a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:21.397543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff897f1d-b1a3-46cd-b715-184e3871809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:21.398110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff897f1d-b1a3-46cd-b715-184e3871809d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:21.398390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff897f1d-b1a3-46cd-b715-184e3871809d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:21.398663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff897f1d-b1a3-46cd-b715-184e3871809d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:21.412449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff897f1d-b1a3-46cd-b715-184e3871809d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-ff897f1d-b1a3-46cd-b715-184e3871809d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 17:00:21.417602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:21.418760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:21.419783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 626/1235] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Sep 19 17:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:21.427628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181efee-f9ca-4b40-bcc5-bd631866cb3e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:21.478593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:21.539650 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181efee-f9ca-4b40-bcc5-bd631866cb3e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:21.577618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece14ad-0adc-4591-84ad-eb2c15ae9c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:21.578451 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece14ad-0adc-4591-84ad-eb2c15ae9c3e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:21.578741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece14ad-0adc-4591-84ad-eb2c15ae9c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:21.579015 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece14ad-0adc-4591-84ad-eb2c15ae9c3e None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:21.579774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece14ad-0adc-4591-84ad-eb2c15ae9c3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:21.580103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece14ad-0adc-4591-84ad-eb2c15ae9c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:21.581806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece14ad-0adc-4591-84ad-eb2c15ae9c3e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:21.590500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 610/1236] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Sep 19 17:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:21.596694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff897f1d-b1a3-46cd-b715-184e3871809d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:21.688858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:21.708283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff897f1d-b1a3-46cd-b715-184e3871809d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:21.745221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4f4f4-ed54-408b-80cd-660fcb172a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:21.745873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4f4f4-ed54-408b-80cd-660fcb172a95 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:21.746507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4f4f4-ed54-408b-80cd-660fcb172a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:21.746507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4f4f4-ed54-408b-80cd-660fcb172a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:21.756685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4f4f4-ed54-408b-80cd-660fcb172a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:21.758556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4f4f4-ed54-408b-80cd-660fcb172a95 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-11a4f4f4-ed54-408b-80cd-660fcb172a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:21.773542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:21.774828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:21.775912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:21.775912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:21.775912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:21.775912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 627/1237] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:21.780647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece14ad-0adc-4591-84ad-eb2c15ae9c3e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:21.899414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece14ad-0adc-4591-84ad-eb2c15ae9c3e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:21.910709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:21.938537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8200fd-7f3a-4e5c-9ce5-870c54d56f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:21.939232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8200fd-7f3a-4e5c-9ce5-870c54d56f5a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:21.939493 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8200fd-7f3a-4e5c-9ce5-870c54d56f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:21.939761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8200fd-7f3a-4e5c-9ce5-870c54d56f5a None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:21.940640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8200fd-7f3a-4e5c-9ce5-870c54d56f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:21.940953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8200fd-7f3a-4e5c-9ce5-870c54d56f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:21.942972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8200fd-7f3a-4e5c-9ce5-870c54d56f5a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:21.956238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 611/1238] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:21.963300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4f4f4-ed54-408b-80cd-660fcb172a95 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:22.079780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4f4f4-ed54-408b-80cd-660fcb172a95 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:22.119097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720f3ed-7b61-4f05-88f6-e939877fd73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:22.119831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720f3ed-7b61-4f05-88f6-e939877fd73d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:22.120119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720f3ed-7b61-4f05-88f6-e939877fd73d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:22.120541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720f3ed-7b61-4f05-88f6-e939877fd73d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:22.124182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:22.129839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720f3ed-7b61-4f05-88f6-e939877fd73d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:22.131456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720f3ed-7b61-4f05-88f6-e939877fd73d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-f720f3ed-7b61-4f05-88f6-e939877fd73d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 17:00:22.143799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:22.145076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:22.146666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 628/1239] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:22.151176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8200fd-7f3a-4e5c-9ce5-870c54d56f5a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:22.255969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8200fd-7f3a-4e5c-9ce5-870c54d56f5a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:22.290365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0236-28fe-41ae-aa6e-9e84d324fd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:22.291182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0236-28fe-41ae-aa6e-9e84d324fd9b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:22.291597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0236-28fe-41ae-aa6e-9e84d324fd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:22.291985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0236-28fe-41ae-aa6e-9e84d324fd9b None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:22.292934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f0236-28fe-41ae-aa6e-9e84d324fd9b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:22.293367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f0236-28fe-41ae-aa6e-9e84d324fd9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:22.295035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f0236-28fe-41ae-aa6e-9e84d324fd9b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:22.313238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 612/1240] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Sep 19 17:00:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:22.319276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720f3ed-7b61-4f05-88f6-e939877fd73d None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:22.438918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720f3ed-7b61-4f05-88f6-e939877fd73d None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:22.479278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd9aac-dc6d-4319-83a6-bd82bcb6a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:22.479904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd9aac-dc6d-4319-83a6-bd82bcb6a936 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:22.480184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd9aac-dc6d-4319-83a6-bd82bcb6a936 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:22.480460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd9aac-dc6d-4319-83a6-bd82bcb6a936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:22.550465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:22.558077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd9aac-dc6d-4319-83a6-bd82bcb6a936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:22.559811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd9aac-dc6d-4319-83a6-bd82bcb6a936 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:22.674001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 629/1241] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 17:00:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 17:00:22.675288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0236-28fe-41ae-aa6e-9e84d324fd9b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:22.706521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:22.790603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0236-28fe-41ae-aa6e-9e84d324fd9b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:22.830743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ba400-c595-4be4-8a0a-18e969cd4403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:22.831303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ba400-c595-4be4-8a0a-18e969cd4403 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:22.831601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ba400-c595-4be4-8a0a-18e969cd4403 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:22.831898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ba400-c595-4be4-8a0a-18e969cd4403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:22.844242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ba400-c595-4be4-8a0a-18e969cd4403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:22.845838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ba400-c595-4be4-8a0a-18e969cd4403 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7a7ba400-c595-4be4-8a0a-18e969cd4403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:22.864166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:22.866709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:22.867804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:22.867804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:22.867804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:22.867804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 613/1242] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:22.873603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd9aac-dc6d-4319-83a6-bd82bcb6a936 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:22.981268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:22.988943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd9aac-dc6d-4319-83a6-bd82bcb6a936 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:23.027608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95584212-0109-4403-8657-c43d24164d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:23.028235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95584212-0109-4403-8657-c43d24164d82 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:23.028506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95584212-0109-4403-8657-c43d24164d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:23.028769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95584212-0109-4403-8657-c43d24164d82 None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:23.029442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95584212-0109-4403-8657-c43d24164d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:23.029738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95584212-0109-4403-8657-c43d24164d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:23.031105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95584212-0109-4403-8657-c43d24164d82 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:23.047467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 630/1243] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:23.049107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ba400-c595-4be4-8a0a-18e969cd4403 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:23.142795 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:23.171661 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ba400-c595-4be4-8a0a-18e969cd4403 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:23.209346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58752d9f-76b5-4ed6-82a0-a1199987c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:23.210144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58752d9f-76b5-4ed6-82a0-a1199987c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:23.210491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58752d9f-76b5-4ed6-82a0-a1199987c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:23.210836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58752d9f-76b5-4ed6-82a0-a1199987c6b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:23.219351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58752d9f-76b5-4ed6-82a0-a1199987c6b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:23.221413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58752d9f-76b5-4ed6-82a0-a1199987c6b0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-58752d9f-76b5-4ed6-82a0-a1199987c6b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 17:00:23.236000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:23.237393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:23.238561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 17:00:23.238561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 17:00:23.238561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 17:00:23.238561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 17:00:23.238561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 17:00:23.238561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 17:00:23.238561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:23.238561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:23.238561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 614/1244] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 17:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 17:00:23.243954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95584212-0109-4403-8657-c43d24164d82 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:23.354465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95584212-0109-4403-8657-c43d24164d82 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:23.393271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd1259-fde3-46da-8396-47db990cb8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:23.393827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1259-fde3-46da-8396-47db990cb8fc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:23.394290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1259-fde3-46da-8396-47db990cb8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:23.394498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd1259-fde3-46da-8396-47db990cb8fc None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:23.395358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd1259-fde3-46da-8396-47db990cb8fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:23.395820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd1259-fde3-46da-8396-47db990cb8fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:23.397826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd1259-fde3-46da-8396-47db990cb8fc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:23.411653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 631/1245] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 17:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:23.418043 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58752d9f-76b5-4ed6-82a0-a1199987c6b0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:23.530224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58752d9f-76b5-4ed6-82a0-a1199987c6b0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:23.568671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951080d-0fbd-40c0-bc96-3a1bf67357c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:23.569365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951080d-0fbd-40c0-bc96-3a1bf67357c2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:23.569643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951080d-0fbd-40c0-bc96-3a1bf67357c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:23.569887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951080d-0fbd-40c0-bc96-3a1bf67357c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:23.570727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951080d-0fbd-40c0-bc96-3a1bf67357c2 None admin] RBAC: Adding query filter params (role.id=0af1ff2cf6f948529ec7cece6eca90d4, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=4716f9539151414dadd9e4b8f13ffc0b) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:23.571125 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951080d-0fbd-40c0-bc96-3a1bf67357c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:23.572677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951080d-0fbd-40c0-bc96-3a1bf67357c2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:23.579408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 615/1246] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 17:00:23 2022] GET /identity/v3/role_assignments?user.id=4716f9539151414dadd9e4b8f13ffc0b&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=0af1ff2cf6f948529ec7cece6eca90d4 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:25.962255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcbc30-0b73-4754-bd83-3e468d8a90a4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:25.962812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcbc30-0b73-4754-bd83-3e468d8a90a4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:25.962812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcbc30-0b73-4754-bd83-3e468d8a90a4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:25.964114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 632/1247] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:25.969818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0ef9-e693-4539-b403-54d05f4e3363 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:25.970331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0ef9-e693-4539-b403-54d05f4e3363 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:25.970331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0ef9-e693-4539-b403-54d05f4e3363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:25.977135 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:25.990053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0dec0ef9-e693-4539-b403-54d05f4e3363 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:25.991342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0dec0ef9-e693-4539-b403-54d05f4e3363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:26.065463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 616/1248] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 17:00:26.328950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcbc30-0b73-4754-bd83-3e468d8a90a4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:26.347916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:26.437380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcbc30-0b73-4754-bd83-3e468d8a90a4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:26.471874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af6454-46b4-4138-9474-629ce04d4ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:26.472501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af6454-46b4-4138-9474-629ce04d4ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:26.472775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af6454-46b4-4138-9474-629ce04d4ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:26.473063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af6454-46b4-4138-9474-629ce04d4ce3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:26.482856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af6454-46b4-4138-9474-629ce04d4ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-75af6454-46b4-4138-9474-629ce04d4ce3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 17:00:26.488131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:26.489089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:26.489931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 633/1249] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 17:00:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 17:00:26.496180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0ef9-e693-4539-b403-54d05f4e3363 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:26.610553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0ef9-e693-4539-b403-54d05f4e3363 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:26.643923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:26.650104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372238-1b86-4d29-ba42-80ba7ae27dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:26.650834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372238-1b86-4d29-ba42-80ba7ae27dbd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:26.651143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372238-1b86-4d29-ba42-80ba7ae27dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:26.651451 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372238-1b86-4d29-ba42-80ba7ae27dbd None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:26.652206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4372238-1b86-4d29-ba42-80ba7ae27dbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:26.652568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4372238-1b86-4d29-ba42-80ba7ae27dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:26.654172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4372238-1b86-4d29-ba42-80ba7ae27dbd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:26.663836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 617/1250] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 17:00:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:26.670325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af6454-46b4-4138-9474-629ce04d4ce3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:26.752069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:26.777682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af6454-46b4-4138-9474-629ce04d4ce3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:26.816542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f8fb6-cfdd-412a-a33c-868326172c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:26.817288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f8fb6-cfdd-412a-a33c-868326172c99 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:26.817679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f8fb6-cfdd-412a-a33c-868326172c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:26.817971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f8fb6-cfdd-412a-a33c-868326172c99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:26.828510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f8fb6-cfdd-412a-a33c-868326172c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:26.829995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f8fb6-cfdd-412a-a33c-868326172c99 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-7b5f8fb6-cfdd-412a-a33c-868326172c99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:26.847122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:26.848337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:26.849393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:26.849393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:26.849393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:26.850549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 634/1251] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:26.857488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372238-1b86-4d29-ba42-80ba7ae27dbd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:26.965008 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372238-1b86-4d29-ba42-80ba7ae27dbd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:27.000129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318a50-ce63-431d-bd53-a4bcc7186ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:27.000778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318a50-ce63-431d-bd53-a4bcc7186ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:27.001073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318a50-ce63-431d-bd53-a4bcc7186ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:27.001359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318a50-ce63-431d-bd53-a4bcc7186ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:27.002037 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08318a50-ce63-431d-bd53-a4bcc7186ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:27.002399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08318a50-ce63-431d-bd53-a4bcc7186ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:27.003846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08318a50-ce63-431d-bd53-a4bcc7186ee9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:27.016915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 618/1252] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:27.022859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f8fb6-cfdd-412a-a33c-868326172c99 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:27.126933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f8fb6-cfdd-412a-a33c-868326172c99 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:27.157491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:27.166124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597cec1-e559-410b-92ef-57b1832ad143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:27.166776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597cec1-e559-410b-92ef-57b1832ad143 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:27.167058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597cec1-e559-410b-92ef-57b1832ad143 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:27.167335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597cec1-e559-410b-92ef-57b1832ad143 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:27.175160 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597cec1-e559-410b-92ef-57b1832ad143 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:27.176905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597cec1-e559-410b-92ef-57b1832ad143 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-8597cec1-e559-410b-92ef-57b1832ad143 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 17:00:27.188907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:27.190276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:27.191443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 635/1253] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:27.196249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318a50-ce63-431d-bd53-a4bcc7186ee9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:27.255318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:27.300981 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318a50-ce63-431d-bd53-a4bcc7186ee9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:27.334928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237018f-246e-48b2-9763-b57e576b332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:27.335538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237018f-246e-48b2-9763-b57e576b332e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:27.335816 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237018f-246e-48b2-9763-b57e576b332e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:27.336079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237018f-246e-48b2-9763-b57e576b332e None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:27.336809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237018f-246e-48b2-9763-b57e576b332e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:27.337142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237018f-246e-48b2-9763-b57e576b332e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:27.338582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237018f-246e-48b2-9763-b57e576b332e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:27.355555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 619/1254] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Sep 19 17:00:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:27.361245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597cec1-e559-410b-92ef-57b1832ad143 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:27.464750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597cec1-e559-410b-92ef-57b1832ad143 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:27.498994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edd8dc-e76b-4a3a-870e-80a3cfdea66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:27.499621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edd8dc-e76b-4a3a-870e-80a3cfdea66a None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:27.499909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edd8dc-e76b-4a3a-870e-80a3cfdea66a None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:27.500225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edd8dc-e76b-4a3a-870e-80a3cfdea66a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:27.556137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:27.568812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edd8dc-e76b-4a3a-870e-80a3cfdea66a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:27.570320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edd8dc-e76b-4a3a-870e-80a3cfdea66a None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:27.681814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 636/1255] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 17:00:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 17:00:27.688314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237018f-246e-48b2-9763-b57e576b332e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:27.789871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237018f-246e-48b2-9763-b57e576b332e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:27.804586 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:27.828082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dce4d-1e1e-4271-96a1-191cbaea2f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:27.828636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dce4d-1e1e-4271-96a1-191cbaea2f28 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:27.828922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dce4d-1e1e-4271-96a1-191cbaea2f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:27.829216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0dce4d-1e1e-4271-96a1-191cbaea2f28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:27.839636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dce4d-1e1e-4271-96a1-191cbaea2f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:27.841205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0dce4d-1e1e-4271-96a1-191cbaea2f28 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4f0dce4d-1e1e-4271-96a1-191cbaea2f28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:27.860511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:27.861834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:27.862868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:27.862868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:27.862868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:27.862868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 620/1256] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:27.867686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edd8dc-e76b-4a3a-870e-80a3cfdea66a None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:27.963605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:27.976830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edd8dc-e76b-4a3a-870e-80a3cfdea66a None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:28.014578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2edb-3631-4cc3-b7ab-d481fb5e87fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:28.015208 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2edb-3631-4cc3-b7ab-d481fb5e87fc None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:28.015485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2edb-3631-4cc3-b7ab-d481fb5e87fc None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:28.015751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea2edb-3631-4cc3-b7ab-d481fb5e87fc None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:28.016756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2edb-3631-4cc3-b7ab-d481fb5e87fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:28.017077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2edb-3631-4cc3-b7ab-d481fb5e87fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:28.018456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea2edb-3631-4cc3-b7ab-d481fb5e87fc None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:28.030824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 637/1257] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:28.036994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dce4d-1e1e-4271-96a1-191cbaea2f28 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:28.149695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0dce4d-1e1e-4271-96a1-191cbaea2f28 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:28.186297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe05f-928e-4ca2-b616-c40ea553b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:28.186941 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe05f-928e-4ca2-b616-c40ea553b7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:28.187214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe05f-928e-4ca2-b616-c40ea553b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:28.187479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe05f-928e-4ca2-b616-c40ea553b7b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:28.195456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe05f-928e-4ca2-b616-c40ea553b7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:28.196939 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe05f-928e-4ca2-b616-c40ea553b7b8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0c6fe05f-928e-4ca2-b616-c40ea553b7b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 17:00:28.209874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:28.211023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:28.212182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 17:00:28.212182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 17:00:28.212182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 17:00:28.212182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 17:00:28.212182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 17:00:28.212182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 17:00:28.212182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:28.212182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:28.216347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 621/1258] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 17:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:28.217361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2edb-3631-4cc3-b7ab-d481fb5e87fc None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:28.325984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea2edb-3631-4cc3-b7ab-d481fb5e87fc None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:28.360288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0d112-8b0c-42cc-8cd7-d3dca0c30173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:28.360956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0d112-8b0c-42cc-8cd7-d3dca0c30173 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:28.361261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0d112-8b0c-42cc-8cd7-d3dca0c30173 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:28.361528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0d112-8b0c-42cc-8cd7-d3dca0c30173 None admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:28.362338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0d112-8b0c-42cc-8cd7-d3dca0c30173 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:28.362623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0d112-8b0c-42cc-8cd7-d3dca0c30173 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:28.364096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0d112-8b0c-42cc-8cd7-d3dca0c30173 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:28.376290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 638/1259] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 17:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:28.382637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe05f-928e-4ca2-b616-c40ea553b7b8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:28.409667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:28.484911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe05f-928e-4ca2-b616-c40ea553b7b8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:28.521922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729e137-ce58-492d-95f1-7afb0e4fde96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:28.522681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729e137-ce58-492d-95f1-7afb0e4fde96 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:28.522965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729e137-ce58-492d-95f1-7afb0e4fde96 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:28.523272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729e137-ce58-492d-95f1-7afb0e4fde96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:28.523997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729e137-ce58-492d-95f1-7afb0e4fde96 None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=4716f9539151414dadd9e4b8f13ffc0b) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:28.524303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729e137-ce58-492d-95f1-7afb0e4fde96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:28.525775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729e137-ce58-492d-95f1-7afb0e4fde96 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:28.531478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 622/1260] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 17:00:28 2022] GET /identity/v3/role_assignments?user.id=4716f9539151414dadd9e4b8f13ffc0b&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=77285ef607e34662b6234656fe8043d0 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:30.643086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b667-9a3d-4e37-b35e-ff86fd3131ed None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:30.643951 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b667-9a3d-4e37-b35e-ff86fd3131ed None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:30.643951 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b667-9a3d-4e37-b35e-ff86fd3131ed None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:30.646106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 639/1261] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:30.654654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d1db4-3510-40ca-b1e0-b6c7e324fa79 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:30.655059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d1db4-3510-40ca-b1e0-b6c7e324fa79 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:30.655265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d1db4-3510-40ca-b1e0-b6c7e324fa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:30.681491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1a4d1db4-3510-40ca-b1e0-b6c7e324fa79 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:30.682706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1a4d1db4-3510-40ca-b1e0-b6c7e324fa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:30.752952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 623/1262] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 17:00:31.023509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b667-9a3d-4e37-b35e-ff86fd3131ed None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:31.038480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:31.155826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b667-9a3d-4e37-b35e-ff86fd3131ed None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:31.192621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676acc90-bc77-4701-834f-d6f476076272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:31.193288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676acc90-bc77-4701-834f-d6f476076272 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:31.193567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676acc90-bc77-4701-834f-d6f476076272 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:31.193836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676acc90-bc77-4701-834f-d6f476076272 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:31.205211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676acc90-bc77-4701-834f-d6f476076272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-676acc90-bc77-4701-834f-d6f476076272 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 17:00:31.210018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:31.211062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:31.211925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 640/1263] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 17:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:31.217504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d1db4-3510-40ca-b1e0-b6c7e324fa79 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:31.236332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:31.323970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d1db4-3510-40ca-b1e0-b6c7e324fa79 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:31.362178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fad92-5143-4bcd-a7a4-8ad415b41905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:31.362783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fad92-5143-4bcd-a7a4-8ad415b41905 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:31.363062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fad92-5143-4bcd-a7a4-8ad415b41905 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:31.363330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fad92-5143-4bcd-a7a4-8ad415b41905 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:31.363984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fad92-5143-4bcd-a7a4-8ad415b41905 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:31.364287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fad92-5143-4bcd-a7a4-8ad415b41905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:31.365690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fad92-5143-4bcd-a7a4-8ad415b41905 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:31.373846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 624/1264] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 17:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:31.380325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676acc90-bc77-4701-834f-d6f476076272 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:31.453669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:31.488120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676acc90-bc77-4701-834f-d6f476076272 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:31.523594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e98805-b736-4a2f-b08f-69c38b69b0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:31.524217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e98805-b736-4a2f-b08f-69c38b69b0be None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:31.524499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e98805-b736-4a2f-b08f-69c38b69b0be None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:31.524772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e98805-b736-4a2f-b08f-69c38b69b0be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:31.535411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e98805-b736-4a2f-b08f-69c38b69b0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:31.536861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e98805-b736-4a2f-b08f-69c38b69b0be None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-19e98805-b736-4a2f-b08f-69c38b69b0be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:31.551929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:31.553012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:31.554323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:31.554323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:31.554323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:31.554323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 641/1265] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:31.559042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fad92-5143-4bcd-a7a4-8ad415b41905 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:31.665844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:31.694984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fad92-5143-4bcd-a7a4-8ad415b41905 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:31.730143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498521c-359e-4f8c-a3fe-9a1684aedc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:31.730755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498521c-359e-4f8c-a3fe-9a1684aedc1d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:31.731034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498521c-359e-4f8c-a3fe-9a1684aedc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:31.731307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498521c-359e-4f8c-a3fe-9a1684aedc1d None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:31.731953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498521c-359e-4f8c-a3fe-9a1684aedc1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:31.732258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498521c-359e-4f8c-a3fe-9a1684aedc1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:31.733671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498521c-359e-4f8c-a3fe-9a1684aedc1d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:31.745481 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 625/1266] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:31.753990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e98805-b736-4a2f-b08f-69c38b69b0be None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:31.861101 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e98805-b736-4a2f-b08f-69c38b69b0be None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:31.881740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:31.896835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde39aa-4528-456e-86d9-820390c26697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:31.897532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde39aa-4528-456e-86d9-820390c26697 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:31.897830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde39aa-4528-456e-86d9-820390c26697 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:31.898171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde39aa-4528-456e-86d9-820390c26697 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:31.905427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde39aa-4528-456e-86d9-820390c26697 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:31.906883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde39aa-4528-456e-86d9-820390c26697 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-3dde39aa-4528-456e-86d9-820390c26697 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 17:00:31.921330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:31.922474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:31.923654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:31.923654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:31.923654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 17:00:31.923654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 17:00:31.923654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 17:00:31.923654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 17:00:31.923654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 17:00:31.923654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 17:00:31.923654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:31.923654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:31.925228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 642/1267] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 17:00:31.931056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498521c-359e-4f8c-a3fe-9a1684aedc1d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:32.052784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498521c-359e-4f8c-a3fe-9a1684aedc1d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:32.089473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ec4b-a81d-4098-950d-ceb27eb9eaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:32.090085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ec4b-a81d-4098-950d-ceb27eb9eaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:32.090360 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ec4b-a81d-4098-950d-ceb27eb9eaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:32.090630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ec4b-a81d-4098-950d-ceb27eb9eaa5 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:32.091366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ec4b-a81d-4098-950d-ceb27eb9eaa5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:32.091667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ec4b-a81d-4098-950d-ceb27eb9eaa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:32.093098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ec4b-a81d-4098-950d-ceb27eb9eaa5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:32.101696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:32.113982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 626/1268] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Sep 19 17:00:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:32.120139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde39aa-4528-456e-86d9-820390c26697 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:32.236821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde39aa-4528-456e-86d9-820390c26697 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:32.272068 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137ad5-b309-45de-ab67-ceada4b8feb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:32.272687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137ad5-b309-45de-ab67-ceada4b8feb2 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:32.272969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137ad5-b309-45de-ab67-ceada4b8feb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:32.273273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0137ad5-b309-45de-ab67-ceada4b8feb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:32.284612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0137ad5-b309-45de-ab67-ceada4b8feb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:32.286112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0137ad5-b309-45de-ab67-ceada4b8feb2 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-b0137ad5-b309-45de-ab67-ceada4b8feb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:32.300623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:32.301919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:32.303209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:32.303209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:32.303209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:32.303209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 643/1269] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:32.307694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ec4b-a81d-4098-950d-ceb27eb9eaa5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:32.413930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ec4b-a81d-4098-950d-ceb27eb9eaa5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:32.449474 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dd39f-bb96-4e73-8dbc-d7e257c536e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:32.450077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd39f-bb96-4e73-8dbc-d7e257c536e2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:32.450350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd39f-bb96-4e73-8dbc-d7e257c536e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:32.450624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd39f-bb96-4e73-8dbc-d7e257c536e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:32.451263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dd39f-bb96-4e73-8dbc-d7e257c536e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:32.451564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dd39f-bb96-4e73-8dbc-d7e257c536e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:32.452927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dd39f-bb96-4e73-8dbc-d7e257c536e2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:32.464207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 627/1270] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:32.470708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137ad5-b309-45de-ab67-ceada4b8feb2 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:32.504803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:32.583133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0137ad5-b309-45de-ab67-ceada4b8feb2 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:32.620074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75d5f4-8fa7-4571-807c-bc3e7fe490a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:32.620689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75d5f4-8fa7-4571-807c-bc3e7fe490a3 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:32.620966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75d5f4-8fa7-4571-807c-bc3e7fe490a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:32.621270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75d5f4-8fa7-4571-807c-bc3e7fe490a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:32.628594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75d5f4-8fa7-4571-807c-bc3e7fe490a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:32.630063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75d5f4-8fa7-4571-807c-bc3e7fe490a3 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-de75d5f4-8fa7-4571-807c-bc3e7fe490a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 17:00:32.642309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:32.643360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:32.649167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 17:00:32.649167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 17:00:32.649167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 17:00:32.649167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 17:00:32.649167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 17:00:32.649167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 17:00:32.649167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:32.649167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:32.649167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 644/1271] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 17:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:32.649810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dd39f-bb96-4e73-8dbc-d7e257c536e2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:32.712487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:32.756655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dd39f-bb96-4e73-8dbc-d7e257c536e2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:32.792041 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92075bdf-359b-4ef1-9515-c732f307e322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:32.792638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075bdf-359b-4ef1-9515-c732f307e322 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:32.792924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075bdf-359b-4ef1-9515-c732f307e322 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:32.793222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075bdf-359b-4ef1-9515-c732f307e322 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:32.793922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92075bdf-359b-4ef1-9515-c732f307e322 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:32.794228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92075bdf-359b-4ef1-9515-c732f307e322 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:32.795660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92075bdf-359b-4ef1-9515-c732f307e322 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:32.807731 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 628/1272] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 17:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:32.814595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75d5f4-8fa7-4571-807c-bc3e7fe490a3 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:32.913733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:32.923481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75d5f4-8fa7-4571-807c-bc3e7fe490a3 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:32.957526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dff0b2-4de9-4847-9de8-79ff6c0fb035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:32.958174 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dff0b2-4de9-4847-9de8-79ff6c0fb035 None admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:32.958453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dff0b2-4de9-4847-9de8-79ff6c0fb035 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:32.958729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dff0b2-4de9-4847-9de8-79ff6c0fb035 None admin] PATH_INFO: `/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/4716f9539151414dadd9e4b8f13ffc0b/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:32.960727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dff0b2-4de9-4847-9de8-79ff6c0fb035 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ba93fb5d194d92977c52a16dc1e336, user_id=4716f9539151414dadd9e4b8f13ffc0b, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:32.962205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dff0b2-4de9-4847-9de8-79ff6c0fb035 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:32.978444 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 645/1273] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Sep 19 17:00:32 2022] PUT /identity/v3/projects/66ba93fb5d194d92977c52a16dc1e336/users/4716f9539151414dadd9e4b8f13ffc0b/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:00:35.095098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea97593-fae1-41ad-b5b8-efe04d373a75 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:35.095705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea97593-fae1-41ad-b5b8-efe04d373a75 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:35.095705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea97593-fae1-41ad-b5b8-efe04d373a75 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:35.097387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 629/1274] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:35.103688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156427-d4b6-4247-91c8-d71c9516df91 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:35.104421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156427-d4b6-4247-91c8-d71c9516df91 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:35.104583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51156427-d4b6-4247-91c8-d71c9516df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:35.128186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-51156427-d4b6-4247-91c8-d71c9516df91 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:35.129451 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-51156427-d4b6-4247-91c8-d71c9516df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:35.202629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 646/1275] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 17:00:35.476346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea97593-fae1-41ad-b5b8-efe04d373a75 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:35.593209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea97593-fae1-41ad-b5b8-efe04d373a75 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:35.611367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:35.629865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549f77c-b2a1-4101-9c4d-97dcf7600821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:35.630487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549f77c-b2a1-4101-9c4d-97dcf7600821 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:35.630767 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549f77c-b2a1-4101-9c4d-97dcf7600821 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:35.631063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549f77c-b2a1-4101-9c4d-97dcf7600821 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:35.642000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549f77c-b2a1-4101-9c4d-97dcf7600821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c549f77c-b2a1-4101-9c4d-97dcf7600821 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 17:00:35.646776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:35.647848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:35.648701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 630/1276] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Sep 19 17:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:35.654106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51156427-d4b6-4247-91c8-d71c9516df91 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:35.738329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:35.757476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51156427-d4b6-4247-91c8-d71c9516df91 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:35.792774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9390eb3-532e-4b9b-b92f-b97295fd1608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:35.793408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390eb3-532e-4b9b-b92f-b97295fd1608 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:35.793689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390eb3-532e-4b9b-b92f-b97295fd1608 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:35.793965 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390eb3-532e-4b9b-b92f-b97295fd1608 None admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:35.794629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9390eb3-532e-4b9b-b92f-b97295fd1608 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:35.794936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9390eb3-532e-4b9b-b92f-b97295fd1608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:35.796297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9390eb3-532e-4b9b-b92f-b97295fd1608 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:35.804550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 647/1277] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Sep 19 17:00:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:35.811096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549f77c-b2a1-4101-9c4d-97dcf7600821 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:35.927303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549f77c-b2a1-4101-9c4d-97dcf7600821 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:35.963131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a377b4d-281a-4c03-938b-c90a66d6688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:35.963754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a377b4d-281a-4c03-938b-c90a66d6688d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:35.964035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a377b4d-281a-4c03-938b-c90a66d6688d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:35.964309 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a377b4d-281a-4c03-938b-c90a66d6688d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:35.974587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a377b4d-281a-4c03-938b-c90a66d6688d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:35.976045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a377b4d-281a-4c03-938b-c90a66d6688d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9a377b4d-281a-4c03-938b-c90a66d6688d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:35.992329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:35.993504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:35.994438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:35.994438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:35.994438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:35.994438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 631/1278] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:35.999408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9390eb3-532e-4b9b-b92f-b97295fd1608 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:36.112611 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9390eb3-532e-4b9b-b92f-b97295fd1608 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:36.146989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2972-1928-431f-bd3b-777b1be9577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:36.147593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2972-1928-431f-bd3b-777b1be9577e None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:36.147873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2972-1928-431f-bd3b-777b1be9577e None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:36.148140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c2972-1928-431f-bd3b-777b1be9577e None admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:36.148788 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c2972-1928-431f-bd3b-777b1be9577e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:36.149088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c2972-1928-431f-bd3b-777b1be9577e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:36.150465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c2972-1928-431f-bd3b-777b1be9577e None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:36.162340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 648/1279] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:36.168198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a377b4d-281a-4c03-938b-c90a66d6688d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:36.200716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:36.273298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a377b4d-281a-4c03-938b-c90a66d6688d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:36.314519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9ab02-9c5c-48d7-901e-9fc4b254cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:36.315361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9ab02-9c5c-48d7-901e-9fc4b254cdfa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:36.315633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9ab02-9c5c-48d7-901e-9fc4b254cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:36.315893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9ab02-9c5c-48d7-901e-9fc4b254cdfa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:36.323791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9ab02-9c5c-48d7-901e-9fc4b254cdfa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:36.325270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9ab02-9c5c-48d7-901e-9fc4b254cdfa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-2eb9ab02-9c5c-48d7-901e-9fc4b254cdfa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 17:00:36.336584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:36.337716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:36.338681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 632/1280] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 17:00:36.343813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2972-1928-431f-bd3b-777b1be9577e None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:36.347831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:36.447300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c2972-1928-431f-bd3b-777b1be9577e None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:36.483163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1a8d8-09b4-4c5c-88bf-012eee4fd2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:36.483760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1a8d8-09b4-4c5c-88bf-012eee4fd2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:36.484047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1a8d8-09b4-4c5c-88bf-012eee4fd2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:36.484320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1a8d8-09b4-4c5c-88bf-012eee4fd2b0 None admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:36.485016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1a8d8-09b4-4c5c-88bf-012eee4fd2b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:36.485385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1a8d8-09b4-4c5c-88bf-012eee4fd2b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:36.486918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1a8d8-09b4-4c5c-88bf-012eee4fd2b0 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:36.503735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 649/1281] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Sep 19 17:00:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:36.512519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9ab02-9c5c-48d7-901e-9fc4b254cdfa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:36.610980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:36.623294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9ab02-9c5c-48d7-901e-9fc4b254cdfa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:36.660970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb74f5-a3c8-4a51-b0ac-08221bc8210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:36.661591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb74f5-a3c8-4a51-b0ac-08221bc8210a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:36.661874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb74f5-a3c8-4a51-b0ac-08221bc8210a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:36.662144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb74f5-a3c8-4a51-b0ac-08221bc8210a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:36.735366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb74f5-a3c8-4a51-b0ac-08221bc8210a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:36.736872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb74f5-a3c8-4a51-b0ac-08221bc8210a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:36.832266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:36.847560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 633/1282] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Sep 19 17:00:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 17:00:36.853814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1a8d8-09b4-4c5c-88bf-012eee4fd2b0 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:36.914690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:36.955760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1a8d8-09b4-4c5c-88bf-012eee4fd2b0 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:36.991780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd2e1-af23-4264-b127-b3b190d75898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:36.992404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd2e1-af23-4264-b127-b3b190d75898 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:36.992685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd2e1-af23-4264-b127-b3b190d75898 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:36.992955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfd2e1-af23-4264-b127-b3b190d75898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:37.003606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfd2e1-af23-4264-b127-b3b190d75898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:37.005072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfd2e1-af23-4264-b127-b3b190d75898 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-40bfd2e1-af23-4264-b127-b3b190d75898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 17:00:37.020117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:37.028766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 17:00:37.030048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 17:00:37.030048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 17:00:37.030048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:37.030048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 650/1283] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:37.030335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb74f5-a3c8-4a51-b0ac-08221bc8210a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:37.150164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb74f5-a3c8-4a51-b0ac-08221bc8210a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:37.186040 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663c648-168a-42c0-90a2-ef493532986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:37.186618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663c648-168a-42c0-90a2-ef493532986f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:37.186832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663c648-168a-42c0-90a2-ef493532986f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:37.187097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663c648-168a-42c0-90a2-ef493532986f None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:37.187739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663c648-168a-42c0-90a2-ef493532986f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:37.188042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663c648-168a-42c0-90a2-ef493532986f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:37.189552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663c648-168a-42c0-90a2-ef493532986f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:37.200911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 634/1284] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Sep 19 17:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:37.206958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd2e1-af23-4264-b127-b3b190d75898 None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:37.323288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfd2e1-af23-4264-b127-b3b190d75898 None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:37.341341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:37.369723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb184d47-41b1-441f-92ff-c10b26f50caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:37.370357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184d47-41b1-441f-92ff-c10b26f50caa None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:37.370628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184d47-41b1-441f-92ff-c10b26f50caa None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:37.370892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184d47-41b1-441f-92ff-c10b26f50caa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:37.381395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb184d47-41b1-441f-92ff-c10b26f50caa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:37.382848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb184d47-41b1-441f-92ff-c10b26f50caa None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application [None req-fb184d47-41b1-441f-92ff-c10b26f50caa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 17:00:37.394570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:37.396067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:37.397466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 17:00:37.397466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 17:00:37.397466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 17:00:37.397466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 17:00:37.397466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 17:00:37.397466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 17:00:37.397466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 17:00:37.397466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: ERROR keystone.server.flask.application Sep 19 17:00:37.397466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 651/1285] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Sep 19 17:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:37.402120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663c648-168a-42c0-90a2-ef493532986f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:37.463505 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:37.521307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663c648-168a-42c0-90a2-ef493532986f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:37.555986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e64c6b-ab53-460a-9f21-c7f5437c9162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:37.556593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64c6b-ab53-460a-9f21-c7f5437c9162 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:37.556870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64c6b-ab53-460a-9f21-c7f5437c9162 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:37.557172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e64c6b-ab53-460a-9f21-c7f5437c9162 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:37.557857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e64c6b-ab53-460a-9f21-c7f5437c9162 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:37.558157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e64c6b-ab53-460a-9f21-c7f5437c9162 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:37.559581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e64c6b-ab53-460a-9f21-c7f5437c9162 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:37.571580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 635/1286] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Sep 19 17:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:37.581729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb184d47-41b1-441f-92ff-c10b26f50caa None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:37.698653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb184d47-41b1-441f-92ff-c10b26f50caa None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:37.735033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48586e0a-7671-4c5e-adcd-fcca7192d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:37.735633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48586e0a-7671-4c5e-adcd-fcca7192d6ca None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:37.735921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48586e0a-7671-4c5e-adcd-fcca7192d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:37.736194 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48586e0a-7671-4c5e-adcd-fcca7192d6ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:37.736967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48586e0a-7671-4c5e-adcd-fcca7192d6ca None admin] RBAC: Adding query filter params (role.id=77285ef607e34662b6234656fe8043d0, scope.project.id=66ba93fb5d194d92977c52a16dc1e336, user.id=4716f9539151414dadd9e4b8f13ffc0b) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:37.737311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48586e0a-7671-4c5e-adcd-fcca7192d6ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:37.738759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48586e0a-7671-4c5e-adcd-fcca7192d6ca None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:37.744902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 652/1287] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Sep 19 17:00:37 2022] GET /identity/v3/role_assignments?user.id=4716f9539151414dadd9e4b8f13ffc0b&scope.project.id=66ba93fb5d194d92977c52a16dc1e336&role.id=77285ef607e34662b6234656fe8043d0 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:39.915551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58158780-c579-419a-81f9-a8508fbfe200 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:39.916119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58158780-c579-419a-81f9-a8508fbfe200 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:39.916211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58158780-c579-419a-81f9-a8508fbfe200 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:39.917679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 636/1288] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:39.922940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0cb51-5f03-4781-9366-9ba6a9b36704 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:39.923368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0cb51-5f03-4781-9366-9ba6a9b36704 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:39.923458 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0cb51-5f03-4781-9366-9ba6a9b36704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:39.942188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-42e0cb51-5f03-4781-9366-9ba6a9b36704 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:39.943380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-42e0cb51-5f03-4781-9366-9ba6a9b36704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:39.973194 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:40.024512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 653/1289] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 17:00:40.290154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58158780-c579-419a-81f9-a8508fbfe200 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:40.403501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58158780-c579-419a-81f9-a8508fbfe200 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:40.414074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:40.444507 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244a46e-ac01-4f33-a486-5860ef549a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:40.445171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244a46e-ac01-4f33-a486-5860ef549a44 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:40.445451 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244a46e-ac01-4f33-a486-5860ef549a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:40.445718 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244a46e-ac01-4f33-a486-5860ef549a44 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:40.446296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244a46e-ac01-4f33-a486-5860ef549a44 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:40.447682 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244a46e-ac01-4f33-a486-5860ef549a44 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-2244a46e-ac01-4f33-a486-5860ef549a44 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:40.456965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:40.458164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 17:00:40.459274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:40.461218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 637/1290] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Sep 19 17:00:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:40.464199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0cb51-5f03-4781-9366-9ba6a9b36704 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:40.567777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0cb51-5f03-4781-9366-9ba6a9b36704 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:40.602426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b51070-6b7d-40ea-8ee5-aec976645b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:40.603018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b51070-6b7d-40ea-8ee5-aec976645b3f None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:40.603305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b51070-6b7d-40ea-8ee5-aec976645b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:40.603577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b51070-6b7d-40ea-8ee5-aec976645b3f None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:40.604209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b51070-6b7d-40ea-8ee5-aec976645b3f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:40.604516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b51070-6b7d-40ea-8ee5-aec976645b3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:40.605937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b51070-6b7d-40ea-8ee5-aec976645b3f None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:40.610819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 654/1291] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Sep 19 17:00:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:00:40.617344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244a46e-ac01-4f33-a486-5860ef549a44 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:40.722845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244a46e-ac01-4f33-a486-5860ef549a44 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:40.760640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303b8c0-ad31-4c22-97fe-45eb285b4db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:40.761267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b8c0-ad31-4c22-97fe-45eb285b4db1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:40.761545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b8c0-ad31-4c22-97fe-45eb285b4db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:40.761817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b8c0-ad31-4c22-97fe-45eb285b4db1 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:40.762446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303b8c0-ad31-4c22-97fe-45eb285b4db1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:40.762744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303b8c0-ad31-4c22-97fe-45eb285b4db1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:40.764109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303b8c0-ad31-4c22-97fe-45eb285b4db1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:40.769114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 638/1292] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Sep 19 17:00:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:42.909105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f185-187b-46fa-8cc9-c25e13f29d78 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:42.909754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f185-187b-46fa-8cc9-c25e13f29d78 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:42.909754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f185-187b-46fa-8cc9-c25e13f29d78 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:42.911068 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 655/1293] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:42.917446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264041-99f9-450d-adde-43d77820a2da None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:42.917895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264041-99f9-450d-adde-43d77820a2da None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:42.917988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264041-99f9-450d-adde-43d77820a2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:42.936439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-42264041-99f9-450d-adde-43d77820a2da None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:42.937657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-42264041-99f9-450d-adde-43d77820a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:42.967901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:43.006764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 639/1294] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 17:00:43.272328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582f185-187b-46fa-8cc9-c25e13f29d78 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:43.307725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:43.382566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582f185-187b-46fa-8cc9-c25e13f29d78 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:43.418298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f33e34-bf09-454a-9f71-6c27a5701b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:43.418896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33e34-bf09-454a-9f71-6c27a5701b8d None admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:43.419186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33e34-bf09-454a-9f71-6c27a5701b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:43.419452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33e34-bf09-454a-9f71-6c27a5701b8d None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:43.420104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f33e34-bf09-454a-9f71-6c27a5701b8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:43.421540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f33e34-bf09-454a-9f71-6c27a5701b8d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:43.443858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 656/1295] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Sep 19 17:00:43 2022] POST /identity/v3/services => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:00:45.557062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e411-8f6a-4ac3-8910-fe44de55dfb3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:45.557636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e411-8f6a-4ac3-8910-fe44de55dfb3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:45.557636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6e411-8f6a-4ac3-8910-fe44de55dfb3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:45.558990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 640/1296] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:45.565362 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe2f0-5d60-46f5-b3e7-721d4c7effdf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:45.566069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe2f0-5d60-46f5-b3e7-721d4c7effdf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:45.566265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe2f0-5d60-46f5-b3e7-721d4c7effdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:45.591359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a5ffe2f0-5d60-46f5-b3e7-721d4c7effdf None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:45.592552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a5ffe2f0-5d60-46f5-b3e7-721d4c7effdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:45.668135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 657/1297] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:45 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 17:00:45.938880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6e411-8f6a-4ac3-8910-fe44de55dfb3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:46.048534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6e411-8f6a-4ac3-8910-fe44de55dfb3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:46.084121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cacb9-0b6b-4c3a-bcff-1d1a9efe07cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:46.084745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cacb9-0b6b-4c3a-bcff-1d1a9efe07cf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:46.085021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cacb9-0b6b-4c3a-bcff-1d1a9efe07cf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:46.085326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cacb9-0b6b-4c3a-bcff-1d1a9efe07cf None admin] PATH_INFO: `/v3/services/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:46.085902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cacb9-0b6b-4c3a-bcff-1d1a9efe07cf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:46.087271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cacb9-0b6b-4c3a-bcff-1d1a9efe07cf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-142cacb9-0b6b-4c3a-bcff-1d1a9efe07cf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:46.096199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:46.097399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:46.098355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 641/1298] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Sep 19 17:00:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:46.103386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffe2f0-5d60-46f5-b3e7-721d4c7effdf None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:46.124244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:46.210153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffe2f0-5d60-46f5-b3e7-721d4c7effdf None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:46.251707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862b746-7da7-415b-9a6b-2ceaf2f819aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:46.252323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862b746-7da7-415b-9a6b-2ceaf2f819aa None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:46.252582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862b746-7da7-415b-9a6b-2ceaf2f819aa None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:46.252884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862b746-7da7-415b-9a6b-2ceaf2f819aa None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:46.253550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862b746-7da7-415b-9a6b-2ceaf2f819aa None admin] RBAC: Adding query filter params (name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:46.253854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862b746-7da7-415b-9a6b-2ceaf2f819aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:46.255240 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862b746-7da7-415b-9a6b-2ceaf2f819aa None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:46.260302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 658/1299] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Sep 19 17:00:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:46.266952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cacb9-0b6b-4c3a-bcff-1d1a9efe07cf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:46.299973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:46.374046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cacb9-0b6b-4c3a-bcff-1d1a9efe07cf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:46.409430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a0357-1ff6-4e51-9b41-b1640f3858a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:46.410029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a0357-1ff6-4e51-9b41-b1640f3858a4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:46.410310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a0357-1ff6-4e51-9b41-b1640f3858a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:46.410584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a0357-1ff6-4e51-9b41-b1640f3858a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:46.411286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a0357-1ff6-4e51-9b41-b1640f3858a4 None admin] RBAC: Adding query filter params (interface=public, service_id=afdb55de88ea416880718ae256e544f1, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:46.411592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a0357-1ff6-4e51-9b41-b1640f3858a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:46.412964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a0357-1ff6-4e51-9b41-b1640f3858a4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:46.418176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 642/1300] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Sep 19 17:00:46 2022] GET /identity/v3/endpoints?service_id=afdb55de88ea416880718ae256e544f1&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:46.424813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862b746-7da7-415b-9a6b-2ceaf2f819aa None admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:46.517048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:46.538033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862b746-7da7-415b-9a6b-2ceaf2f819aa None admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:46.585642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d1b64-6307-4cb4-a817-cefebc7ef703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:46.586233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1b64-6307-4cb4-a817-cefebc7ef703 None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:46.586510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1b64-6307-4cb4-a817-cefebc7ef703 None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:46.586783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d1b64-6307-4cb4-a817-cefebc7ef703 None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:46.587387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d1b64-6307-4cb4-a817-cefebc7ef703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:46.588751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d1b64-6307-4cb4-a817-cefebc7ef703 None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:46.595768 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 659/1301] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Sep 19 17:00:46 2022] GET /identity/v3/services => generated 2191 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:00:48.694974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbc6b0-d216-4d62-bad7-0eca08f1f023 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:48.695653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbc6b0-d216-4d62-bad7-0eca08f1f023 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:48.695653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbc6b0-d216-4d62-bad7-0eca08f1f023 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:48.696884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 643/1302] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:00:48.703002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f471804-be72-4e06-9d4f-a271bdaf2c07 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:48.703446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f471804-be72-4e06-9d4f-a271bdaf2c07 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:48.703560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f471804-be72-4e06-9d4f-a271bdaf2c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:48.727294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3f471804-be72-4e06-9d4f-a271bdaf2c07 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:00:48.729225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3f471804-be72-4e06-9d4f-a271bdaf2c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:00:48.803430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 660/1303] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:00:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 17:00:49.065817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbc6b0-d216-4d62-bad7-0eca08f1f023 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:49.187774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:49.197777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbc6b0-d216-4d62-bad7-0eca08f1f023 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:49.234786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48f733-dc15-4ae8-a25f-628fb27bf9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:49.235408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48f733-dc15-4ae8-a25f-628fb27bf9fe None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:49.235687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48f733-dc15-4ae8-a25f-628fb27bf9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:49.235964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48f733-dc15-4ae8-a25f-628fb27bf9fe None admin] PATH_INFO: `/v3/services/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:49.236548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48f733-dc15-4ae8-a25f-628fb27bf9fe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:49.238158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48f733-dc15-4ae8-a25f-628fb27bf9fe None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5b48f733-dc15-4ae8-a25f-628fb27bf9fe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 17:00:49.247052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 17:00:49.248220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: ERROR keystone.server.flask.application Sep 19 17:00:49.249113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 644/1304] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Sep 19 17:00:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 17:00:49.254433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f471804-be72-4e06-9d4f-a271bdaf2c07 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:49.333134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:49.368769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f471804-be72-4e06-9d4f-a271bdaf2c07 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:49.403735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14cb8b-5e70-4bea-91b5-e0ae431edc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:49.404332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14cb8b-5e70-4bea-91b5-e0ae431edc3d None admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:49.404622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14cb8b-5e70-4bea-91b5-e0ae431edc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:49.404894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14cb8b-5e70-4bea-91b5-e0ae431edc3d None admin] PATH_INFO: `/v3/services` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:49.405549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14cb8b-5e70-4bea-91b5-e0ae431edc3d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:00:49.405853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14cb8b-5e70-4bea-91b5-e0ae431edc3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:49.407218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14cb8b-5e70-4bea-91b5-e0ae431edc3d None admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:49.412383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 661/1305] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Sep 19 17:00:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:00:49.418395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48f733-dc15-4ae8-a25f-628fb27bf9fe None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:00:49.531464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48f733-dc15-4ae8-a25f-628fb27bf9fe None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:00:49.566534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e68d5-d1e2-47bc-ade8-d9af5c5333a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:00:49.567147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e68d5-d1e2-47bc-ade8-d9af5c5333a9 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:00:49.567409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e68d5-d1e2-47bc-ade8-d9af5c5333a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:00:49.567663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e68d5-d1e2-47bc-ade8-d9af5c5333a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:00:49.568318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e68d5-d1e2-47bc-ade8-d9af5c5333a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:00:49.569714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e68d5-d1e2-47bc-ade8-d9af5c5333a9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:00:49.595965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 645/1306] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:00:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:00:59.409935 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=30 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:00:59.587994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:01:53.813009 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacab32-864d-4064-a7fa-8a26a0f65268 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:01:53.814011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacab32-864d-4064-a7fa-8a26a0f65268 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:01:53.814448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacab32-864d-4064-a7fa-8a26a0f65268 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:01:53.816024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 662/1307] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:01:53.822334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd6ad9-588e-46c0-b628-cc20228516b2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:01:53.822935 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd6ad9-588e-46c0-b628-cc20228516b2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:01:53.823140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd6ad9-588e-46c0-b628-cc20228516b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:01:53.907177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fefd6ad9-588e-46c0-b628-cc20228516b2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:01:53.908576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fefd6ad9-588e-46c0-b628-cc20228516b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:01:54.046219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 646/1308] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:01:54.340562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c15691-7cff-491f-92d8-dd047d669bf7 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:01:54.341442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c15691-7cff-491f-92d8-dd047d669bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:01:54.341442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c15691-7cff-491f-92d8-dd047d669bf7 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:01:54.342857 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 663/1309] 10.222.0.76 () {54 vars in 963 bytes} [Mon Sep 19 17:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:01:54.349753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69f53c-7eb3-4559-ae1a-4d4ddcc06033 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:01:54.350134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69f53c-7eb3-4559-ae1a-4d4ddcc06033 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:01:54.350339 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69f53c-7eb3-4559-ae1a-4d4ddcc06033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:01:54.446336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ff69f53c-7eb3-4559-ae1a-4d4ddcc06033 None None] MFA Rules not processed for user `da4a83dd0cb64e219bc16f8cf0b0af57`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:01:54.447575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ff69f53c-7eb3-4559-ae1a-4d4ddcc06033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:01:54.475601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:01:54.544352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 647/1310] 10.222.0.76 () {58 vars in 1060 bytes} [Mon Sep 19 17:01:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:01:54.554149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c15691-7cff-491f-92d8-dd047d669bf7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:01:54.555914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-03c15691-7cff-491f-92d8-dd047d669bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:01:54.687970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c15691-7cff-491f-92d8-dd047d669bf7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:01:54.770815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c12fd-3927-4dc6-b342-b6022c52861a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:01:54.771526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c12fd-3927-4dc6-b342-b6022c52861a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:01:54.771823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c12fd-3927-4dc6-b342-b6022c52861a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:01:54.772075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c12fd-3927-4dc6-b342-b6022c52861a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:01:54.773698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-516c12fd-3927-4dc6-b342-b6022c52861a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:01:54.834007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:01:54.898330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c12fd-3927-4dc6-b342-b6022c52861a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:01:54.899867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c12fd-3927-4dc6-b342-b6022c52861a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:01:54.920163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 664/1311] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:01:57.514977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118547c8-19db-4f6d-bfdb-f31d91e6cdd0 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:01:57.515847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118547c8-19db-4f6d-bfdb-f31d91e6cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:01:57.515969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118547c8-19db-4f6d-bfdb-f31d91e6cdd0 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:01:57.517924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 648/1312] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:01:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:01:57.524664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758cc1-7fe4-466e-b2fa-821d4dc1e27b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:01:57.525126 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758cc1-7fe4-466e-b2fa-821d4dc1e27b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:01:57.525340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758cc1-7fe4-466e-b2fa-821d4dc1e27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:01:57.620280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b4758cc1-7fe4-466e-b2fa-821d4dc1e27b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:01:57.621545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b4758cc1-7fe4-466e-b2fa-821d4dc1e27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:01:57.723498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 665/1313] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:01:58.009719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118547c8-19db-4f6d-bfdb-f31d91e6cdd0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:01:58.011271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-118547c8-19db-4f6d-bfdb-f31d91e6cdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:01:58.122650 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118547c8-19db-4f6d-bfdb-f31d91e6cdd0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:01:58.202481 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:01:58.205691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdd8e6-142a-4de3-bee4-d6655fbcf03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:01:58.206665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdd8e6-142a-4de3-bee4-d6655fbcf03f service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:01:58.206937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdd8e6-142a-4de3-bee4-d6655fbcf03f service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:01:58.207601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdd8e6-142a-4de3-bee4-d6655fbcf03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:01:58.209723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-63cdd8e6-142a-4de3-bee4-d6655fbcf03f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:01:58.335682 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdd8e6-142a-4de3-bee4-d6655fbcf03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:01:58.337284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdd8e6-142a-4de3-bee4-d6655fbcf03f service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:01:58.357713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 649/1314] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:01.001217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ccd92-cd51-482e-b741-f3b1d702d20b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:01.001804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ccd92-cd51-482e-b741-f3b1d702d20b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:01.001804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ccd92-cd51-482e-b741-f3b1d702d20b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:01.004331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 666/1315] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:01.013616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58830a27-a5da-483d-85a9-b164b53967a4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:01.014118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58830a27-a5da-483d-85a9-b164b53967a4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:01.014267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58830a27-a5da-483d-85a9-b164b53967a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:01.089659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-58830a27-a5da-483d-85a9-b164b53967a4 None None] MFA Rules not processed for user `43415b08461749e6b1c27fcc1a6883b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:01.090953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-58830a27-a5da-483d-85a9-b164b53967a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:01.151638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:01.202428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 650/1316] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:02:01.489495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ccd92-cd51-482e-b741-f3b1d702d20b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:01.491237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4a6ccd92-cd51-482e-b741-f3b1d702d20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:01.502586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:01.602936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ccd92-cd51-482e-b741-f3b1d702d20b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:01.684143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb277d4-a172-4c79-954e-227b69c7f438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:01.684797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb277d4-a172-4c79-954e-227b69c7f438 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:01.685123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb277d4-a172-4c79-954e-227b69c7f438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:01.685402 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb277d4-a172-4c79-954e-227b69c7f438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:01.687072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3fb277d4-a172-4c79-954e-227b69c7f438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:01.756597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:01.809337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb277d4-a172-4c79-954e-227b69c7f438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:01.810817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb277d4-a172-4c79-954e-227b69c7f438 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:01.830583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 667/1317] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:04.567875 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14238ddb-2855-4149-995b-c110f7e4784f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:04.568985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14238ddb-2855-4149-995b-c110f7e4784f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:04.568985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14238ddb-2855-4149-995b-c110f7e4784f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:04.570959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 651/1318] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:04.577295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad890-05cb-477a-9e40-a5d9f7eb5846 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:04.578046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad890-05cb-477a-9e40-a5d9f7eb5846 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:04.578228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ad890-05cb-477a-9e40-a5d9f7eb5846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:04.648059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-aa7ad890-05cb-477a-9e40-a5d9f7eb5846 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:04.649320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aa7ad890-05cb-477a-9e40-a5d9f7eb5846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:04.754611 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 668/1319] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:05.038284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14238ddb-2855-4149-995b-c110f7e4784f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:05.040687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-14238ddb-2855-4149-995b-c110f7e4784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:05.161535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14238ddb-2855-4149-995b-c110f7e4784f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:05.240181 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151b74b-a4b8-4548-bff6-d2087707384f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:05.240792 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151b74b-a4b8-4548-bff6-d2087707384f service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:05.241075 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151b74b-a4b8-4548-bff6-d2087707384f service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:05.241355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151b74b-a4b8-4548-bff6-d2087707384f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:05.242956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4151b74b-a4b8-4548-bff6-d2087707384f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:05.249872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:05.356441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151b74b-a4b8-4548-bff6-d2087707384f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:05.357822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151b74b-a4b8-4548-bff6-d2087707384f service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:05.376952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 652/1320] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:08.238756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3297-510f-4732-a1fb-4ad39522dd1b None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:08.239328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3297-510f-4732-a1fb-4ad39522dd1b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:08.239328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3297-510f-4732-a1fb-4ad39522dd1b None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:08.240641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 669/1321] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:08.246186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe93c3-9161-47cf-a907-a6c465b49f79 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:08.246636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe93c3-9161-47cf-a907-a6c465b49f79 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:08.246862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe93c3-9161-47cf-a907-a6c465b49f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:08.316070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-33fe93c3-9161-47cf-a907-a6c465b49f79 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:08.317328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-33fe93c3-9161-47cf-a907-a6c465b49f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:08.386944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:08.430675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 653/1322] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:08.719510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014b748-0d6b-459b-811b-6485977986be None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:08.719835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014b748-0d6b-459b-811b-6485977986be None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:08.720111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014b748-0d6b-459b-811b-6485977986be None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:08.721511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 670/1323] 10.222.0.76 () {54 vars in 963 bytes} [Mon Sep 19 17:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:08.727540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412aba6-2316-4285-8394-cba562cd60e2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:08.727726 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412aba6-2316-4285-8394-cba562cd60e2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:08.728025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412aba6-2316-4285-8394-cba562cd60e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:08.806549 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8412aba6-2316-4285-8394-cba562cd60e2 None None] MFA Rules not processed for user `da4a83dd0cb64e219bc16f8cf0b0af57`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:08.807762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8412aba6-2316-4285-8394-cba562cd60e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:08.886527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 654/1324] 10.222.0.76 () {58 vars in 1060 bytes} [Mon Sep 19 17:02:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:08.896314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014b748-0d6b-459b-811b-6485977986be None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:08.898203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c014b748-0d6b-459b-811b-6485977986be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:08.919483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:09.003517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014b748-0d6b-459b-811b-6485977986be None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:09.079298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f39bb-be4c-4633-b6f1-b8992a1c12a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:09.079904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f39bb-be4c-4633-b6f1-b8992a1c12a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:09.080182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f39bb-be4c-4633-b6f1-b8992a1c12a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:09.080459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f39bb-be4c-4633-b6f1-b8992a1c12a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:09.082061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d15f39bb-be4c-4633-b6f1-b8992a1c12a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:09.154466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:09.194789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f39bb-be4c-4633-b6f1-b8992a1c12a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:09.196275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f39bb-be4c-4633-b6f1-b8992a1c12a1 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:09.215822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 671/1325] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:11.610106 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433260e-6f3b-48aa-85e0-92b36fffe131 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:11.613165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433260e-6f3b-48aa-85e0-92b36fffe131 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:11.613165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433260e-6f3b-48aa-85e0-92b36fffe131 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:11.613165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 655/1326] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:11.618088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914cb26-0e4a-458c-b69c-0ef308d24a83 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:11.618735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914cb26-0e4a-458c-b69c-0ef308d24a83 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:11.618735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914cb26-0e4a-458c-b69c-0ef308d24a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:11.700070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f914cb26-0e4a-458c-b69c-0ef308d24a83 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:11.701249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f914cb26-0e4a-458c-b69c-0ef308d24a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:11.801641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 672/1327] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:12.079130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433260e-6f3b-48aa-85e0-92b36fffe131 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:12.080682 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0433260e-6f3b-48aa-85e0-92b36fffe131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:12.142838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:12.192221 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433260e-6f3b-48aa-85e0-92b36fffe131 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:12.268186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcd044-8f64-4d0b-a294-f85ed94431af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:12.268829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcd044-8f64-4d0b-a294-f85ed94431af service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:12.269278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcd044-8f64-4d0b-a294-f85ed94431af service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:12.269563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcd044-8f64-4d0b-a294-f85ed94431af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:12.271164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-09dcd044-8f64-4d0b-a294-f85ed94431af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:12.388507 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:12.391420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcd044-8f64-4d0b-a294-f85ed94431af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:12.393098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcd044-8f64-4d0b-a294-f85ed94431af service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:12.411891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 656/1328] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:14.595281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7237f-6e13-43e2-8036-ba6b94d1cbc2 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:14.595812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7237f-6e13-43e2-8036-ba6b94d1cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:14.595812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7237f-6e13-43e2-8036-ba6b94d1cbc2 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:14.597454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 673/1329] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:14.605881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793b1a2-adf7-42db-ac49-aa0139362bb4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:14.606377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793b1a2-adf7-42db-ac49-aa0139362bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:14.606495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793b1a2-adf7-42db-ac49-aa0139362bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:14.680919 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5793b1a2-adf7-42db-ac49-aa0139362bb4 None None] MFA Rules not processed for user `43415b08461749e6b1c27fcc1a6883b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:14.682179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5793b1a2-adf7-42db-ac49-aa0139362bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:14.783711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 657/1330] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:15.057352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7237f-6e13-43e2-8036-ba6b94d1cbc2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:15.058914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-44d7237f-6e13-43e2-8036-ba6b94d1cbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:15.091622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:15.168199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7237f-6e13-43e2-8036-ba6b94d1cbc2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:15.246336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10211bb6-ed96-4896-8f13-db7db1d36aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:15.246986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10211bb6-ed96-4896-8f13-db7db1d36aaf service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:15.247251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10211bb6-ed96-4896-8f13-db7db1d36aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:15.247521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10211bb6-ed96-4896-8f13-db7db1d36aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:15.249179 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-10211bb6-ed96-4896-8f13-db7db1d36aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:15.334223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:15.366853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10211bb6-ed96-4896-8f13-db7db1d36aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:15.368301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10211bb6-ed96-4896-8f13-db7db1d36aaf service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:15.387646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 674/1331] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:17.746028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d74b-b4f2-4f85-8950-64ad3dd36c07 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:17.746594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d74b-b4f2-4f85-8950-64ad3dd36c07 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:17.746688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d74b-b4f2-4f85-8950-64ad3dd36c07 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:17.748702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 658/1332] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:17.757772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816658d2-69d2-4400-a5bf-2a7e237c1eac None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:17.758529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816658d2-69d2-4400-a5bf-2a7e237c1eac None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:17.758705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816658d2-69d2-4400-a5bf-2a7e237c1eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:17.830876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-816658d2-69d2-4400-a5bf-2a7e237c1eac None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:17.832157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-816658d2-69d2-4400-a5bf-2a7e237c1eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:17.939762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 675/1333] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:18.224387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d74b-b4f2-4f85-8950-64ad3dd36c07 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:18.226026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c3f7d74b-b4f2-4f85-8950-64ad3dd36c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:18.303046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:18.340308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d74b-b4f2-4f85-8950-64ad3dd36c07 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:18.418081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed67f9c-0beb-4fda-8360-7cd8de3eb13e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:18.418612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67f9c-0beb-4fda-8360-7cd8de3eb13e service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:18.418887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67f9c-0beb-4fda-8360-7cd8de3eb13e service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:18.419148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67f9c-0beb-4fda-8360-7cd8de3eb13e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:18.420747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0ed67f9c-0beb-4fda-8360-7cd8de3eb13e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:18.537473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed67f9c-0beb-4fda-8360-7cd8de3eb13e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:18.538941 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed67f9c-0beb-4fda-8360-7cd8de3eb13e service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:18.549878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:18.558742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 659/1334] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:20.780293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d11dd6-e53b-48cd-8bb1-2cb33a284440 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:20.781162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d11dd6-e53b-48cd-8bb1-2cb33a284440 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:20.781299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d11dd6-e53b-48cd-8bb1-2cb33a284440 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:20.790257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 676/1335] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:20.791865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8211c3-8a59-4a74-98fe-f9979cfca1d5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:20.792298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8211c3-8a59-4a74-98fe-f9979cfca1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:20.792387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8211c3-8a59-4a74-98fe-f9979cfca1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:20.865147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5c8211c3-8a59-4a74-98fe-f9979cfca1d5 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:20.866363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5c8211c3-8a59-4a74-98fe-f9979cfca1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:20.967742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 660/1336] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:02:21.251639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d11dd6-e53b-48cd-8bb1-2cb33a284440 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:21.254262 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-74d11dd6-e53b-48cd-8bb1-2cb33a284440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:21.309449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:21.377237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d11dd6-e53b-48cd-8bb1-2cb33a284440 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:21.453409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a59db-3944-42e5-b938-2b15db2a603a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:21.454067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a59db-3944-42e5-b938-2b15db2a603a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:21.454343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a59db-3944-42e5-b938-2b15db2a603a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:21.454605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a59db-3944-42e5-b938-2b15db2a603a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:21.456197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f49a59db-3944-42e5-b938-2b15db2a603a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:21.541882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:21.569048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a59db-3944-42e5-b938-2b15db2a603a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:21.570485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a59db-3944-42e5-b938-2b15db2a603a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:21.589109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 677/1337] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:24.088212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36abb1-d06b-44ee-9617-969a54b92941 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:24.088823 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36abb1-d06b-44ee-9617-969a54b92941 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:24.088823 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36abb1-d06b-44ee-9617-969a54b92941 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:24.090149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 661/1338] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:24.096646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0fa56-d738-41b5-aef2-157e4e33f52d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:24.097352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0fa56-d738-41b5-aef2-157e4e33f52d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:24.097469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0fa56-d738-41b5-aef2-157e4e33f52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:24.176458 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-05c0fa56-d738-41b5-aef2-157e4e33f52d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:24.177714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-05c0fa56-d738-41b5-aef2-157e4e33f52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:24.280884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 678/1339] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:24.572245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36abb1-d06b-44ee-9617-969a54b92941 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:24.574793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8a36abb1-d06b-44ee-9617-969a54b92941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:24.662118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:24.691836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36abb1-d06b-44ee-9617-969a54b92941 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:24.775011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe22eb-8855-4edc-a069-99e3fcfd9de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:24.776321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe22eb-8855-4edc-a069-99e3fcfd9de4 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:24.776522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe22eb-8855-4edc-a069-99e3fcfd9de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:24.776791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe22eb-8855-4edc-a069-99e3fcfd9de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:24.778418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bcbe22eb-8855-4edc-a069-99e3fcfd9de4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:24.895909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe22eb-8855-4edc-a069-99e3fcfd9de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:24.897316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe22eb-8855-4edc-a069-99e3fcfd9de4 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:24.916402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 662/1340] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:29.002340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81427bc3-673e-4818-a511-facc7fd86ff8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:29.002879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81427bc3-673e-4818-a511-facc7fd86ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:29.002879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81427bc3-673e-4818-a511-facc7fd86ff8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:29.004924 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 679/1341] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:29.010173 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854a538-4a79-4a91-8872-7b7538f99dd3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:29.010645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854a538-4a79-4a91-8872-7b7538f99dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:29.010744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854a538-4a79-4a91-8872-7b7538f99dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:29.017673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:29.080525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8854a538-4a79-4a91-8872-7b7538f99dd3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:29.081644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8854a538-4a79-4a91-8872-7b7538f99dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:29.187243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 663/1342] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:29.467758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81427bc3-673e-4818-a511-facc7fd86ff8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:29.469353 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-81427bc3-673e-4818-a511-facc7fd86ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:29.519595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:29.578465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81427bc3-673e-4818-a511-facc7fd86ff8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:29.655189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabba9fd-4db4-4525-a2f7-cebd07acf393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:29.655807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabba9fd-4db4-4525-a2f7-cebd07acf393 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:29.656085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabba9fd-4db4-4525-a2f7-cebd07acf393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:29.656352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabba9fd-4db4-4525-a2f7-cebd07acf393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:29.658029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aabba9fd-4db4-4525-a2f7-cebd07acf393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:29.760488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:29.778513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabba9fd-4db4-4525-a2f7-cebd07acf393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:29.779994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabba9fd-4db4-4525-a2f7-cebd07acf393 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:29.799009 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 680/1343] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:32.886947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c3e05-ab62-4365-9e81-5ce152094860 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:32.887510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c3e05-ab62-4365-9e81-5ce152094860 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:32.887510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c3e05-ab62-4365-9e81-5ce152094860 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:32.889199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 664/1344] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:32.894695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b9b6e-515e-4806-865c-c3a4e0344bda None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:32.895134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b9b6e-515e-4806-865c-c3a4e0344bda None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:32.895313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b9b6e-515e-4806-865c-c3a4e0344bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:32.963617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4a6b9b6e-515e-4806-865c-c3a4e0344bda None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:32.964844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4a6b9b6e-515e-4806-865c-c3a4e0344bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:33.064061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 681/1345] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:33.343488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c3e05-ab62-4365-9e81-5ce152094860 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:33.345250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e52c3e05-ab62-4365-9e81-5ce152094860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:33.438124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:33.455014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c3e05-ab62-4365-9e81-5ce152094860 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:33.545648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec773f-2471-4f56-8f65-4490f5c399bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:33.546275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec773f-2471-4f56-8f65-4490f5c399bd service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:33.546548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec773f-2471-4f56-8f65-4490f5c399bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:33.546808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec773f-2471-4f56-8f65-4490f5c399bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:33.548470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6fec773f-2471-4f56-8f65-4490f5c399bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:33.667192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec773f-2471-4f56-8f65-4490f5c399bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:33.668643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec773f-2471-4f56-8f65-4490f5c399bd service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:33.687259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 665/1346] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:38.028031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f08d-4e1a-422e-a6ed-6bf061f14b53 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:38.028612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f08d-4e1a-422e-a6ed-6bf061f14b53 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:38.028612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f08d-4e1a-422e-a6ed-6bf061f14b53 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:38.029925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 682/1347] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:38.035795 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80041b1a-93ea-411e-9be6-3b88e6fffd8b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:38.036293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80041b1a-93ea-411e-9be6-3b88e6fffd8b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:38.036293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80041b1a-93ea-411e-9be6-3b88e6fffd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:38.059068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:38.108803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-80041b1a-93ea-411e-9be6-3b88e6fffd8b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:38.110092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-80041b1a-93ea-411e-9be6-3b88e6fffd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:38.217312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 666/1348] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:38.501785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f08d-4e1a-422e-a6ed-6bf061f14b53 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:38.504297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f454f08d-4e1a-422e-a6ed-6bf061f14b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:38.573512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:38.621231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f08d-4e1a-422e-a6ed-6bf061f14b53 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:38.698456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65224a-71be-4153-9017-1bcd1027e841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:38.699328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65224a-71be-4153-9017-1bcd1027e841 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:38.699683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65224a-71be-4153-9017-1bcd1027e841 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:38.700055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65224a-71be-4153-9017-1bcd1027e841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:38.702573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dc65224a-71be-4153-9017-1bcd1027e841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:38.810898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:38.814937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65224a-71be-4153-9017-1bcd1027e841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:38.816598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65224a-71be-4153-9017-1bcd1027e841 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:38.837123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 683/1349] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:43.813727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a363c-3840-4056-b803-330f2697a01e None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:43.814616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a363c-3840-4056-b803-330f2697a01e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:43.815052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a363c-3840-4056-b803-330f2697a01e None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:43.816875 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 667/1350] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:43.821798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9a286-28d9-4886-bfd9-2eeb7d4f6134 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:43.822208 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9a286-28d9-4886-bfd9-2eeb7d4f6134 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:43.822326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9a286-28d9-4886-bfd9-2eeb7d4f6134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:43.918264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-86a9a286-28d9-4886-bfd9-2eeb7d4f6134 None None] MFA Rules not processed for user `4716f9539151414dadd9e4b8f13ffc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:43.919652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-86a9a286-28d9-4886-bfd9-2eeb7d4f6134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:44.085753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 684/1351] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:02:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:48.215770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=59 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:48.315749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f15cce-a44e-4657-baf7-d032ec266ed7 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:48.316112 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f15cce-a44e-4657-baf7-d032ec266ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:48.316310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f15cce-a44e-4657-baf7-d032ec266ed7 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:48.317687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 668/1352] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:48.326175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3088d4c-4389-4a87-bea4-e66ccd8f1d0b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:48.326687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3088d4c-4389-4a87-bea4-e66ccd8f1d0b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:48.326687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3088d4c-4389-4a87-bea4-e66ccd8f1d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:48.382899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:48.408503 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d3088d4c-4389-4a87-bea4-e66ccd8f1d0b None None] MFA Rules not processed for user `4716f9539151414dadd9e4b8f13ffc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:48.409870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d3088d4c-4389-4a87-bea4-e66ccd8f1d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:48.530986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 685/1353] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:02:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:49.689522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd166077-0164-4146-bf25-224e33b8e92f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:49.690084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd166077-0164-4146-bf25-224e33b8e92f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:49.690084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd166077-0164-4146-bf25-224e33b8e92f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:49.691448 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 669/1354] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:49.696536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbabbe-006f-4fdb-b791-4bac871a7c1d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:49.697011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbabbe-006f-4fdb-b791-4bac871a7c1d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:49.697155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbabbe-006f-4fdb-b791-4bac871a7c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:49.777166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2dbbabbe-006f-4fdb-b791-4bac871a7c1d None None] MFA Rules not processed for user `4716f9539151414dadd9e4b8f13ffc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:49.778534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2dbbabbe-006f-4fdb-b791-4bac871a7c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:49.823387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:49.894097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 686/1355] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:02:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:53.429664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960960d8-7738-4154-b875-459912e3b794 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:53.430180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960960d8-7738-4154-b875-459912e3b794 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:53.430180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960960d8-7738-4154-b875-459912e3b794 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:53.431448 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 670/1356] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:53.436923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75980b-32de-41d1-aa02-df4d8765ac3e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:53.437401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75980b-32de-41d1-aa02-df4d8765ac3e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:53.437590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75980b-32de-41d1-aa02-df4d8765ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:53.507359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6b75980b-32de-41d1-aa02-df4d8765ac3e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:53.508582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6b75980b-32de-41d1-aa02-df4d8765ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:53.611139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 687/1357] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:53.908701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd44f3-aeb4-4a3c-95be-2a7e8d562648 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:53.909298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd44f3-aeb4-4a3c-95be-2a7e8d562648 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:53.909899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd44f3-aeb4-4a3c-95be-2a7e8d562648 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:53.911485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 671/1358] 10.222.0.76 () {54 vars in 965 bytes} [Mon Sep 19 17:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:02:53.917918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb995a18-587e-48cb-970c-ebeafd22f8cd None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:53.918216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb995a18-587e-48cb-970c-ebeafd22f8cd None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:53.918494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb995a18-587e-48cb-970c-ebeafd22f8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:53.940557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:54.002759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cb995a18-587e-48cb-970c-ebeafd22f8cd None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:54.003981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cb995a18-587e-48cb-970c-ebeafd22f8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:54.129154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 688/1359] 10.222.0.76 () {58 vars in 1062 bytes} [Mon Sep 19 17:02:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:54.137734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd44f3-aeb4-4a3c-95be-2a7e8d562648 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:54.139156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3afd44f3-aeb4-4a3c-95be-2a7e8d562648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:54.294108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd44f3-aeb4-4a3c-95be-2a7e8d562648 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:54.388165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:54.433450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4db0f-66ef-4bd1-9df2-832144e39611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:54.434279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4db0f-66ef-4bd1-9df2-832144e39611 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:54.434666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4db0f-66ef-4bd1-9df2-832144e39611 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:54.435083 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4db0f-66ef-4bd1-9df2-832144e39611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:54.436912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d5d4db0f-66ef-4bd1-9df2-832144e39611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:54.538230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4db0f-66ef-4bd1-9df2-832144e39611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:54.539902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4db0f-66ef-4bd1-9df2-832144e39611 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:54.561544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 672/1360] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:02:56.921638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5eca5-8c7d-45df-ba93-fcb93e3b495a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:56.922245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5eca5-8c7d-45df-ba93-fcb93e3b495a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:56.922245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5eca5-8c7d-45df-ba93-fcb93e3b495a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:56.927548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 689/1361] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:02:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 17:02:56.929171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4814-fe01-44d9-9998-a73f0e49828f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:56.929598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4814-fe01-44d9-9998-a73f0e49828f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:56.929712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d4814-fe01-44d9-9998-a73f0e49828f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:57.003441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-856d4814-fe01-44d9-9998-a73f0e49828f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:02:57.004630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-856d4814-fe01-44d9-9998-a73f0e49828f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:57.043747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:57.115323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 673/1362] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:02:57.414187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5eca5-8c7d-45df-ba93-fcb93e3b495a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:02:57.415726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-96c5eca5-8c7d-45df-ba93-fcb93e3b495a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:57.494211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:57.602305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5eca5-8c7d-45df-ba93-fcb93e3b495a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:02:57.739196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e173339-d350-4773-a12e-46db8291dc67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:02:57.739827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173339-d350-4773-a12e-46db8291dc67 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:02:57.740105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173339-d350-4773-a12e-46db8291dc67 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:02:57.740378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173339-d350-4773-a12e-46db8291dc67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:02:57.742046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4e173339-d350-4773-a12e-46db8291dc67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:02:57.766762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:02:57.834780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e173339-d350-4773-a12e-46db8291dc67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:02:57.836416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e173339-d350-4773-a12e-46db8291dc67 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:02:57.856240 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 690/1363] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:00.366961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df101b-cc0c-4ff3-9c5b-ffd8efd0159a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:00.367489 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df101b-cc0c-4ff3-9c5b-ffd8efd0159a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:00.367489 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df101b-cc0c-4ff3-9c5b-ffd8efd0159a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:00.368982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 674/1364] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:00.374204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23203f-a788-45e7-bb36-70b4c1dcb090 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:00.374637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23203f-a788-45e7-bb36-70b4c1dcb090 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:00.374720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23203f-a788-45e7-bb36-70b4c1dcb090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:00.447519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8c23203f-a788-45e7-bb36-70b4c1dcb090 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:00.449159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8c23203f-a788-45e7-bb36-70b4c1dcb090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:00.556791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:00.569364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 691/1365] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:00.846599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609726d-d274-4440-bb34-2eb5ad972928 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:00.846884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609726d-d274-4440-bb34-2eb5ad972928 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:00.847205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609726d-d274-4440-bb34-2eb5ad972928 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:00.848690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 675/1366] 10.222.0.76 () {54 vars in 965 bytes} [Mon Sep 19 17:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:00.854461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44fc3f-2287-4f7a-8d2c-48d8abca482e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:00.855009 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44fc3f-2287-4f7a-8d2c-48d8abca482e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:00.855928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44fc3f-2287-4f7a-8d2c-48d8abca482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:00.937089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-de44fc3f-2287-4f7a-8d2c-48d8abca482e None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:00.939222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-de44fc3f-2287-4f7a-8d2c-48d8abca482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:01.059053 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 692/1367] 10.222.0.76 () {58 vars in 1062 bytes} [Mon Sep 19 17:03:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:01.067210 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609726d-d274-4440-bb34-2eb5ad972928 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:01.069005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3609726d-d274-4440-bb34-2eb5ad972928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:01.237089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609726d-d274-4440-bb34-2eb5ad972928 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:01.263496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:01.359365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cede1d8-d66f-4222-a873-140a73af4c77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:01.359968 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede1d8-d66f-4222-a873-140a73af4c77 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:01.360246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede1d8-d66f-4222-a873-140a73af4c77 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:01.360514 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede1d8-d66f-4222-a873-140a73af4c77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:01.362186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6cede1d8-d66f-4222-a873-140a73af4c77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:01.461614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cede1d8-d66f-4222-a873-140a73af4c77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:01.463147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cede1d8-d66f-4222-a873-140a73af4c77 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:01.482158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 676/1368] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:01.501457 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e5ab-92ea-40f9-ad7e-95ca2365530d None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:01.501914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e5ab-92ea-40f9-ad7e-95ca2365530d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:01.502029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43e5ab-92ea-40f9-ad7e-95ca2365530d None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:01.503509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 693/1369] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:01.508694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886e014-d431-490d-93ff-6a8bab392dc3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:01.508981 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886e014-d431-490d-93ff-6a8bab392dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:01.509500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886e014-d431-490d-93ff-6a8bab392dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:01.552758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:01.592633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8886e014-d431-490d-93ff-6a8bab392dc3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:01.594086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8886e014-d431-490d-93ff-6a8bab392dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:01.728443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 677/1370] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:02.062435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43251ff-0058-4335-a7e5-105ca6cc5cfe None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:02.062435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43251ff-0058-4335-a7e5-105ca6cc5cfe None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:02.062435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43251ff-0058-4335-a7e5-105ca6cc5cfe None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:02.064742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 694/1371] 10.222.0.76 () {54 vars in 962 bytes} [Mon Sep 19 17:03:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:02.069472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893879d-4185-451b-bedd-f31df837422f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:02.069863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893879d-4185-451b-bedd-f31df837422f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:02.070234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893879d-4185-451b-bedd-f31df837422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:02.160023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b893879d-4185-451b-bedd-f31df837422f None None] MFA Rules not processed for user `7338fa9ff18c42f8bc26710ab8376b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:02.161455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b893879d-4185-451b-bedd-f31df837422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:02.211247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:02.247154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 678/1372] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Sep 19 17:03:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:02.255227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43251ff-0058-4335-a7e5-105ca6cc5cfe None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:02.256834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b43251ff-0058-4335-a7e5-105ca6cc5cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:02.312379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:02.371627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43251ff-0058-4335-a7e5-105ca6cc5cfe None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:02.460730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6094622-d51e-4a84-bd5a-960e4fea8ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:02.461378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6094622-d51e-4a84-bd5a-960e4fea8ecd service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:02.462870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6094622-d51e-4a84-bd5a-960e4fea8ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:02.462870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6094622-d51e-4a84-bd5a-960e4fea8ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:02.463658 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d6094622-d51e-4a84-bd5a-960e4fea8ecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:02.582925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:02.597421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6094622-d51e-4a84-bd5a-960e4fea8ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:02.599172 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6094622-d51e-4a84-bd5a-960e4fea8ecd service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:02.620957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 695/1373] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:03.681877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587e16-3d59-4169-a2c2-6723dda25a92 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:03.682467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587e16-3d59-4169-a2c2-6723dda25a92 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:03.682467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587e16-3d59-4169-a2c2-6723dda25a92 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:03.683746 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 679/1374] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:03.689199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5017b7b-0e12-4820-b2cb-8d9662b31dfa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:03.689632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5017b7b-0e12-4820-b2cb-8d9662b31dfa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:03.689724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5017b7b-0e12-4820-b2cb-8d9662b31dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:03.758273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f5017b7b-0e12-4820-b2cb-8d9662b31dfa None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:03.759488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f5017b7b-0e12-4820-b2cb-8d9662b31dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:03.866705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 696/1375] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:04.155178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587e16-3d59-4169-a2c2-6723dda25a92 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:04.156864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c2587e16-3d59-4169-a2c2-6723dda25a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:04.324989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587e16-3d59-4169-a2c2-6723dda25a92 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:04.376534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:04.440553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321972e7-b27a-4569-87e4-cee304e347a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:04.441312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321972e7-b27a-4569-87e4-cee304e347a1 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:04.441589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321972e7-b27a-4569-87e4-cee304e347a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:04.441844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321972e7-b27a-4569-87e4-cee304e347a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:04.443478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-321972e7-b27a-4569-87e4-cee304e347a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:04.537755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321972e7-b27a-4569-87e4-cee304e347a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:04.539367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321972e7-b27a-4569-87e4-cee304e347a1 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:04.557761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 680/1376] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:06.779626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41209a4-6c48-4b6a-831f-0b5a9ce33eb4 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:06.780256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41209a4-6c48-4b6a-831f-0b5a9ce33eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:06.780466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41209a4-6c48-4b6a-831f-0b5a9ce33eb4 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:06.782133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 697/1377] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:06.787376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029244-0542-49b3-80ab-4fe0c0b9daee None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:06.787877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029244-0542-49b3-80ab-4fe0c0b9daee None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:06.787877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029244-0542-49b3-80ab-4fe0c0b9daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:06.858306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7f029244-0542-49b3-80ab-4fe0c0b9daee None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:06.859643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7f029244-0542-49b3-80ab-4fe0c0b9daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:06.867772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:06.970884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 681/1378] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:07.261317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41209a4-6c48-4b6a-831f-0b5a9ce33eb4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:07.262884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c41209a4-6c48-4b6a-831f-0b5a9ce33eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:07.329260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:07.419000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41209a4-6c48-4b6a-831f-0b5a9ce33eb4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:07.546135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc6088-2c6d-445f-b62d-2652af1de43b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:07.547129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc6088-2c6d-445f-b62d-2652af1de43b service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:07.547566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc6088-2c6d-445f-b62d-2652af1de43b service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:07.547998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc6088-2c6d-445f-b62d-2652af1de43b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:07.550222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fffc6088-2c6d-445f-b62d-2652af1de43b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:07.571586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:07.652390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc6088-2c6d-445f-b62d-2652af1de43b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:07.654371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc6088-2c6d-445f-b62d-2652af1de43b service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:07.680119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 698/1379] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:09.897572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c150b-3158-4733-a77a-b0348c81773d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:09.898119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c150b-3158-4733-a77a-b0348c81773d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:09.898119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c150b-3158-4733-a77a-b0348c81773d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:09.899673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 682/1380] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:09.905336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52978-51a7-4e32-8ded-7c8c0c8192c9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:09.905802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52978-51a7-4e32-8ded-7c8c0c8192c9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:09.906040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52978-51a7-4e32-8ded-7c8c0c8192c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:09.976560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a0a52978-51a7-4e32-8ded-7c8c0c8192c9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:09.977975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a0a52978-51a7-4e32-8ded-7c8c0c8192c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:10.123484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:10.130202 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 699/1381] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:03:10.422046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c150b-3158-4733-a77a-b0348c81773d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:10.423804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0e7c150b-3158-4733-a77a-b0348c81773d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:10.572967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:10.588988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c150b-3158-4733-a77a-b0348c81773d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:10.721331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98260d6-505d-4dfc-a747-e6e43c7610fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:10.721879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98260d6-505d-4dfc-a747-e6e43c7610fa service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:10.722151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98260d6-505d-4dfc-a747-e6e43c7610fa service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:10.722420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98260d6-505d-4dfc-a747-e6e43c7610fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:10.724077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c98260d6-505d-4dfc-a747-e6e43c7610fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:10.821665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98260d6-505d-4dfc-a747-e6e43c7610fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:10.823729 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98260d6-505d-4dfc-a747-e6e43c7610fa service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:10.834575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:10.847925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 683/1382] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:13.912144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacf2ad-714b-477a-9b2d-ebb37fe41bb6 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:13.912752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacf2ad-714b-477a-9b2d-ebb37fe41bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:13.912904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacf2ad-714b-477a-9b2d-ebb37fe41bb6 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:13.915004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 700/1383] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:13.921975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac79c1-d629-47aa-9e5d-833a0e9bd2a6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:13.922435 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac79c1-d629-47aa-9e5d-833a0e9bd2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:13.922597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac79c1-d629-47aa-9e5d-833a0e9bd2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:13.994049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1dac79c1-d629-47aa-9e5d-833a0e9bd2a6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:13.995499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1dac79c1-d629-47aa-9e5d-833a0e9bd2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:14.104257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 684/1384] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:14.390834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacf2ad-714b-477a-9b2d-ebb37fe41bb6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:14.392614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0aacf2ad-714b-477a-9b2d-ebb37fe41bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:14.555406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacf2ad-714b-477a-9b2d-ebb37fe41bb6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:14.648980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:14.705495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84329b64-9b10-4c13-b258-f8fa3afe0ecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:14.706131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84329b64-9b10-4c13-b258-f8fa3afe0ecd service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:14.706410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84329b64-9b10-4c13-b258-f8fa3afe0ecd service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:14.706709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84329b64-9b10-4c13-b258-f8fa3afe0ecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:14.708400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-84329b64-9b10-4c13-b258-f8fa3afe0ecd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:14.962418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84329b64-9b10-4c13-b258-f8fa3afe0ecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:14.963994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84329b64-9b10-4c13-b258-f8fa3afe0ecd service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:14.983791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 701/1385] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:17.204364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fc265-259f-4b24-8f6e-38f2f1c73513 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:17.204944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fc265-259f-4b24-8f6e-38f2f1c73513 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:17.204944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fc265-259f-4b24-8f6e-38f2f1c73513 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:17.206504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 685/1386] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:17.211975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c916ab-4fd6-4052-b2af-5a863374c674 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:17.212410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c916ab-4fd6-4052-b2af-5a863374c674 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:17.212545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c916ab-4fd6-4052-b2af-5a863374c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:17.281021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-12c916ab-4fd6-4052-b2af-5a863374c674 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:17.282262 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-12c916ab-4fd6-4052-b2af-5a863374c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:17.315644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:17.379945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 702/1387] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:17.662178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fc265-259f-4b24-8f6e-38f2f1c73513 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:17.663761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7e7fc265-259f-4b24-8f6e-38f2f1c73513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:17.750916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:17.823239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fc265-259f-4b24-8f6e-38f2f1c73513 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:17.838856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033def15-9280-4d9c-9fe4-b2b940ee305f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:17.839107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033def15-9280-4d9c-9fe4-b2b940ee305f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:17.839376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033def15-9280-4d9c-9fe4-b2b940ee305f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:17.840871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 703/1388] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:17.846094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59fb13-beb4-4b2e-9c86-43365562b8a9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:17.846376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59fb13-beb4-4b2e-9c86-43365562b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:17.846654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59fb13-beb4-4b2e-9c86-43365562b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:17.917741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1a59fb13-beb4-4b2e-9c86-43365562b8a9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:17.918892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1a59fb13-beb4-4b2e-9c86-43365562b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:17.943394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883aae2-6526-43a5-99ce-b6ce71606bc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:17.944029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883aae2-6526-43a5-99ce-b6ce71606bc3 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:17.944308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883aae2-6526-43a5-99ce-b6ce71606bc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:17.944578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883aae2-6526-43a5-99ce-b6ce71606bc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:17.946212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7883aae2-6526-43a5-99ce-b6ce71606bc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:17.986020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:18.019481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 704/1389] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:18.039630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883aae2-6526-43a5-99ce-b6ce71606bc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:18.041302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883aae2-6526-43a5-99ce-b6ce71606bc3 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:18.059613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 686/1390] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:18.318928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a77d6-239e-47fb-b3fc-b5389b04f767 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:18.319413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a77d6-239e-47fb-b3fc-b5389b04f767 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:18.319531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a77d6-239e-47fb-b3fc-b5389b04f767 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:18.320829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 705/1391] 10.222.0.76 () {54 vars in 962 bytes} [Mon Sep 19 17:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:18.326243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42db98-9501-4564-9665-7158a4d37e77 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:18.326682 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42db98-9501-4564-9665-7158a4d37e77 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:18.326783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42db98-9501-4564-9665-7158a4d37e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:18.404512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ac42db98-9501-4564-9665-7158a4d37e77 None None] MFA Rules not processed for user `2c746178628e4df5961982268e642ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:18.405771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ac42db98-9501-4564-9665-7158a4d37e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:18.482621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 687/1392] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Sep 19 17:03:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:18.491996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a77d6-239e-47fb-b3fc-b5389b04f767 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:18.493579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1d1a77d6-239e-47fb-b3fc-b5389b04f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:18.508371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:18.603877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a77d6-239e-47fb-b3fc-b5389b04f767 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:18.681690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448603c-81d8-4ed8-a961-f35e80f9ea19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c746178628e4df5961982268e642ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:18.682309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448603c-81d8-4ed8-a961-f35e80f9ea19 service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:18.682587 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448603c-81d8-4ed8-a961-f35e80f9ea19 service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:18.682860 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448603c-81d8-4ed8-a961-f35e80f9ea19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:18.684470 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d448603c-81d8-4ed8-a961-f35e80f9ea19 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:18.753550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:18.795207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448603c-81d8-4ed8-a961-f35e80f9ea19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:18.796788 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448603c-81d8-4ed8-a961-f35e80f9ea19 service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:18.814824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 706/1393] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:03:19.584000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388678-8ef3-4ebd-95c6-60859d1079de None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:19.584516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388678-8ef3-4ebd-95c6-60859d1079de None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:19.584516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388678-8ef3-4ebd-95c6-60859d1079de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:19.642326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:19.677467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-35388678-8ef3-4ebd-95c6-60859d1079de None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:19.678918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-35388678-8ef3-4ebd-95c6-60859d1079de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:19.767070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 688/1394] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:03:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:19.813023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e72f6-a03b-4f78-b0ca-0226202aee6e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:19.813507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e72f6-a03b-4f78-b0ca-0226202aee6e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:19.813744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e72f6-a03b-4f78-b0ca-0226202aee6e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:19.815261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 707/1395] 10.222.0.76 () {54 vars in 943 bytes} [Mon Sep 19 17:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:19.821717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18605-53ce-412a-8928-79476df19aba None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:19.822028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18605-53ce-412a-8928-79476df19aba None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:19.822298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18605-53ce-412a-8928-79476df19aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:19.905974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-83f18605-53ce-412a-8928-79476df19aba None None] MFA Rules not processed for user `8834ef19c2604e8c828aa4dd32db61a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:19.907098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-83f18605-53ce-412a-8928-79476df19aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:19.965333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:20.017066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 689/1396] 10.222.0.76 () {58 vars in 1040 bytes} [Mon Sep 19 17:03:19 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:20.026673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e72f6-a03b-4f78-b0ca-0226202aee6e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:20.028224 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8f1e72f6-a03b-4f78-b0ca-0226202aee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:20.172903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e72f6-a03b-4f78-b0ca-0226202aee6e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:20.211877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:20.255892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283193d-43d0-4106-8ed9-7e595a556ca3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:20.256177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283193d-43d0-4106-8ed9-7e595a556ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:20.256450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283193d-43d0-4106-8ed9-7e595a556ca3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:20.258027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 690/1397] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:20.263537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5148b17-37d1-45a9-a537-fdad00540031 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:20.263821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5148b17-37d1-45a9-a537-fdad00540031 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:20.264087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5148b17-37d1-45a9-a537-fdad00540031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:20.283289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde9127-9a2b-49d6-835a-744bc60b009d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:20.283837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde9127-9a2b-49d6-835a-744bc60b009d service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:20.284114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde9127-9a2b-49d6-835a-744bc60b009d service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:20.284380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde9127-9a2b-49d6-835a-744bc60b009d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:20.286067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5fde9127-9a2b-49d6-835a-744bc60b009d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:20.332143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a5148b17-37d1-45a9-a537-fdad00540031 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:20.333391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a5148b17-37d1-45a9-a537-fdad00540031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:20.369536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde9127-9a2b-49d6-835a-744bc60b009d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:20.371137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde9127-9a2b-49d6-835a-744bc60b009d service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:20.379692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 708/1398] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:03:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:03:20.436393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 691/1399] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:03:20.729842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde9127-9a2b-49d6-835a-744bc60b009d service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:20.731158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5fde9127-9a2b-49d6-835a-744bc60b009d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:20.806975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:20.837428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde9127-9a2b-49d6-835a-744bc60b009d service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:21.009343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1eb9b-beae-4409-b969-adca91b3539c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:21.009343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1eb9b-beae-4409-b969-adca91b3539c service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:21.009808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1eb9b-beae-4409-b969-adca91b3539c service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:21.009808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1eb9b-beae-4409-b969-adca91b3539c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:21.013685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8fb1eb9b-beae-4409-b969-adca91b3539c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:21.106598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:21.111454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1eb9b-beae-4409-b969-adca91b3539c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:21.113882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1eb9b-beae-4409-b969-adca91b3539c service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:21.133600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 709/1400] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:23.324251 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e089fa-1420-43cc-a761-54878522ded3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:23.324833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e089fa-1420-43cc-a761-54878522ded3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:23.324833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e089fa-1420-43cc-a761-54878522ded3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:23.326175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 692/1401] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:23.331380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdf948-1ee6-4230-a3c2-22b546f86766 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:23.331797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdf948-1ee6-4230-a3c2-22b546f86766 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:23.331981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdf948-1ee6-4230-a3c2-22b546f86766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:23.401643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ffcdf948-1ee6-4230-a3c2-22b546f86766 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:23.402796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ffcdf948-1ee6-4230-a3c2-22b546f86766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:23.505107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 710/1402] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:23.797507 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e089fa-1420-43cc-a761-54878522ded3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:23.799106 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-23e089fa-1420-43cc-a761-54878522ded3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:23.837454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:24.037866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e089fa-1420-43cc-a761-54878522ded3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:24.164125 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:24.176372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a5784-17a0-4541-be9f-e365c55fb467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:24.177175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a5784-17a0-4541-be9f-e365c55fb467 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:24.177525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a5784-17a0-4541-be9f-e365c55fb467 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:24.177802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a5784-17a0-4541-be9f-e365c55fb467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:24.179428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b37a5784-17a0-4541-be9f-e365c55fb467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:24.275729 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a5784-17a0-4541-be9f-e365c55fb467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:24.277368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a5784-17a0-4541-be9f-e365c55fb467 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:24.296109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 693/1403] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:26.491981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6763e-7b1a-4627-bd51-b7531cba3938 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:26.492524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6763e-7b1a-4627-bd51-b7531cba3938 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:26.492524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6763e-7b1a-4627-bd51-b7531cba3938 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:26.493921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 711/1404] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:26.499328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338ddc-d2e9-4bac-8d85-9f78a32cc1f2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:26.500446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338ddc-d2e9-4bac-8d85-9f78a32cc1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:26.500789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3338ddc-d2e9-4bac-8d85-9f78a32cc1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:26.569284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d3338ddc-d2e9-4bac-8d85-9f78a32cc1f2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:26.571305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d3338ddc-d2e9-4bac-8d85-9f78a32cc1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:26.641957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:26.689113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 694/1405] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:26.970279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6763e-7b1a-4627-bd51-b7531cba3938 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:26.971845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-50a6763e-7b1a-4627-bd51-b7531cba3938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:27.045795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:27.138521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6763e-7b1a-4627-bd51-b7531cba3938 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:27.253912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42ffbd-813c-4018-a34d-1a25a3be0f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:27.254530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42ffbd-813c-4018-a34d-1a25a3be0f67 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:27.254804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42ffbd-813c-4018-a34d-1a25a3be0f67 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:27.255072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42ffbd-813c-4018-a34d-1a25a3be0f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:27.256669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9c42ffbd-813c-4018-a34d-1a25a3be0f67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:27.291964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:27.360026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42ffbd-813c-4018-a34d-1a25a3be0f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:27.361840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42ffbd-813c-4018-a34d-1a25a3be0f67 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:27.382135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 712/1406] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:29.601082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039905e3-7c5c-4814-829d-24fb3791786d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:29.602021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039905e3-7c5c-4814-829d-24fb3791786d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:29.602483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039905e3-7c5c-4814-829d-24fb3791786d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:29.608485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 695/1407] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:03:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:29.610111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456974d-9ac4-4b3d-9513-56792ca89f92 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:29.610554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456974d-9ac4-4b3d-9513-56792ca89f92 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:29.610716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456974d-9ac4-4b3d-9513-56792ca89f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:29.687397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3456974d-9ac4-4b3d-9513-56792ca89f92 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:29.688618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3456974d-9ac4-4b3d-9513-56792ca89f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:29.790848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 713/1408] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:03:30.078861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039905e3-7c5c-4814-829d-24fb3791786d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:30.080404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-039905e3-7c5c-4814-829d-24fb3791786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:30.248602 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039905e3-7c5c-4814-829d-24fb3791786d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:30.300054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:30.371572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0cf5d-6a3a-450c-9969-329e1c00d8ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:30.372096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0cf5d-6a3a-450c-9969-329e1c00d8ba service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:30.372376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0cf5d-6a3a-450c-9969-329e1c00d8ba service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:30.372636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0cf5d-6a3a-450c-9969-329e1c00d8ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:30.374297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-49d0cf5d-6a3a-450c-9969-329e1c00d8ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:30.473466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0cf5d-6a3a-450c-9969-329e1c00d8ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:30.475198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0cf5d-6a3a-450c-9969-329e1c00d8ba service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:30.494553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 696/1409] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:39.788991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:40.495189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=76 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:43.014070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c251e1-1046-43e4-8c39-d997f8c5de22 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:43.014653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c251e1-1046-43e4-8c39-d997f8c5de22 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:43.014653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c251e1-1046-43e4-8c39-d997f8c5de22 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:43.016644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 714/1410] 10.222.0.76 () {54 vars in 918 bytes} [Mon Sep 19 17:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:43.022035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1550-a8ab-4fc0-b09e-0fa191f54f08 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:43.022525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1550-a8ab-4fc0-b09e-0fa191f54f08 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:43.022525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb1550-a8ab-4fc0-b09e-0fa191f54f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:43.105089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c8fb1550-a8ab-4fc0-b09e-0fa191f54f08 None None] MFA Rules not processed for user `4716f9539151414dadd9e4b8f13ffc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:43.106339 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c8fb1550-a8ab-4fc0-b09e-0fa191f54f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:43.219681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 697/1411] 10.222.0.76 () {58 vars in 1015 bytes} [Mon Sep 19 17:03:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:43.238121 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3e44-fdb4-42ea-8ddf-83794df2979f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:43.238405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3e44-fdb4-42ea-8ddf-83794df2979f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:43.238681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a3e44-fdb4-42ea-8ddf-83794df2979f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:43.240073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 715/1412] 10.222.0.76 () {54 vars in 918 bytes} [Mon Sep 19 17:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:43.244960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74dbd6-88b2-4196-ac04-4e4d86b901e7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:43.245273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74dbd6-88b2-4196-ac04-4e4d86b901e7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:43.245545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74dbd6-88b2-4196-ac04-4e4d86b901e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:43.323396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:43.326700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bd74dbd6-88b2-4196-ac04-4e4d86b901e7 None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:43.328677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bd74dbd6-88b2-4196-ac04-4e4d86b901e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:43.462554 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 698/1413] 10.222.0.76 () {58 vars in 1015 bytes} [Mon Sep 19 17:03:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:46.026901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7ec01-fefd-4899-9af6-9f72fd0a6130 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:46.027515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7ec01-fefd-4899-9af6-9f72fd0a6130 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:46.027515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7ec01-fefd-4899-9af6-9f72fd0a6130 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:46.028808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:46.035341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c74b4-fa71-4aa2-9011-f70e595a7736 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:46.036067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c74b4-fa71-4aa2-9011-f70e595a7736 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:46.036178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c74b4-fa71-4aa2-9011-f70e595a7736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:46.113459 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fb7c74b4-fa71-4aa2-9011-f70e595a7736 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:46.114680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fb7c74b4-fa71-4aa2-9011-f70e595a7736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:46.180612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:46.225756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:46.518343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7ec01-fefd-4899-9af6-9f72fd0a6130 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:46.520127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3fa7ec01-fefd-4899-9af6-9f72fd0a6130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:46.669833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7ec01-fefd-4899-9af6-9f72fd0a6130 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:46.745287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:46.805628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca2724-0442-46ac-8c5b-973b39138ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:46.806146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca2724-0442-46ac-8c5b-973b39138ae9 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:46.806424 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca2724-0442-46ac-8c5b-973b39138ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:46.806701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca2724-0442-46ac-8c5b-973b39138ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:46.809006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a4ca2724-0442-46ac-8c5b-973b39138ae9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:46.902031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca2724-0442-46ac-8c5b-973b39138ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:46.903664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca2724-0442-46ac-8c5b-973b39138ae9 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:46.923212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 717/1416] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:48.060372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4219-7c0b-46f7-a2fc-695aa1cee3ed None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:48.061005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4219-7c0b-46f7-a2fc-695aa1cee3ed None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:48.061005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4219-7c0b-46f7-a2fc-695aa1cee3ed None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:48.062441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:48.068771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfedec2-8731-467b-95b6-fc0d23a752fe None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:48.069330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfedec2-8731-467b-95b6-fc0d23a752fe None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:48.069330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfedec2-8731-467b-95b6-fc0d23a752fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:48.148955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bbfedec2-8731-467b-95b6-fc0d23a752fe None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:48.150205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bbfedec2-8731-467b-95b6-fc0d23a752fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:48.177793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:48.252054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:48.404227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba4219-7c0b-46f7-a2fc-695aa1cee3ed None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:48.405810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-59ba4219-7c0b-46f7-a2fc-695aa1cee3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:48.562290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba4219-7c0b-46f7-a2fc-695aa1cee3ed None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:48.605605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:48.681637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f966f-cfc7-481e-bee9-413f8cfacc1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:48.682169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f966f-cfc7-481e-bee9-413f8cfacc1d service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:48.682443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f966f-cfc7-481e-bee9-413f8cfacc1d service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:48.682708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f966f-cfc7-481e-bee9-413f8cfacc1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:48.684311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d95f966f-cfc7-481e-bee9-413f8cfacc1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:48.780804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f966f-cfc7-481e-bee9-413f8cfacc1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:48.782458 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f966f-cfc7-481e-bee9-413f8cfacc1d service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:48.800904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 701/1419] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:49.929412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b1ccc-a285-43b3-99f9-cf9f4760b488 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:49.930241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b1ccc-a285-43b3-99f9-cf9f4760b488 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:49.930241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b1ccc-a285-43b3-99f9-cf9f4760b488 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:49.932403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:03:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:49.939647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baef36-562e-44c4-845f-05b2e6f5eb8e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:49.940156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baef36-562e-44c4-845f-05b2e6f5eb8e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:49.940156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baef36-562e-44c4-845f-05b2e6f5eb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:50.005092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:50.029240 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-71baef36-562e-44c4-845f-05b2e6f5eb8e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:50.030475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-71baef36-562e-44c4-845f-05b2e6f5eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:50.136120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:50.289842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b1ccc-a285-43b3-99f9-cf9f4760b488 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:50.291374 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-db9b1ccc-a285-43b3-99f9-cf9f4760b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:50.455377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b1ccc-a285-43b3-99f9-cf9f4760b488 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:50.467678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:50.583237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04397e6-811d-49f6-806b-88d42e949e65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:50.583850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04397e6-811d-49f6-806b-88d42e949e65 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:50.584132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04397e6-811d-49f6-806b-88d42e949e65 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:50.584406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04397e6-811d-49f6-806b-88d42e949e65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:50.586065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e04397e6-811d-49f6-806b-88d42e949e65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:50.684232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04397e6-811d-49f6-806b-88d42e949e65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:50.686017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04397e6-811d-49f6-806b-88d42e949e65 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:50.705690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 720/1422] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:51.818806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aba6c9-c3e9-483b-a696-1f47ca9308f4 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:51.819414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aba6c9-c3e9-483b-a696-1f47ca9308f4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:51.819414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aba6c9-c3e9-483b-a696-1f47ca9308f4 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:51.820727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:51.828154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaefc4-b76b-4bd5-96fb-f5bd12e8bdae None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:51.828936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaefc4-b76b-4bd5-96fb-f5bd12e8bdae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:51.829158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaefc4-b76b-4bd5-96fb-f5bd12e8bdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:51.855960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:51.914507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cbcaefc4-b76b-4bd5-96fb-f5bd12e8bdae None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:51.915731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cbcaefc4-b76b-4bd5-96fb-f5bd12e8bdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:52.020059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:52.168351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aba6c9-c3e9-483b-a696-1f47ca9308f4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:52.169940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-97aba6c9-c3e9-483b-a696-1f47ca9308f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:52.290378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:52.328537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aba6c9-c3e9-483b-a696-1f47ca9308f4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:52.455861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa5459-6de3-4ead-a348-e49371c8bbd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:52.456470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5459-6de3-4ead-a348-e49371c8bbd4 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:52.456746 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5459-6de3-4ead-a348-e49371c8bbd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:52.457013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa5459-6de3-4ead-a348-e49371c8bbd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:52.458652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5bfa5459-6de3-4ead-a348-e49371c8bbd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:52.565866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:52.584094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa5459-6de3-4ead-a348-e49371c8bbd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:52.585759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa5459-6de3-4ead-a348-e49371c8bbd4 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:52.605195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 704/1425] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:53.719984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da60ec-af00-4c64-b3ce-2d5cbb062c57 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:53.720585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da60ec-af00-4c64-b3ce-2d5cbb062c57 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:53.720585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da60ec-af00-4c64-b3ce-2d5cbb062c57 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:53.721914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:53.729487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e91c8-1de5-4699-8ee8-54cc3a2b2791 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:53.730212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e91c8-1de5-4699-8ee8-54cc3a2b2791 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:53.730373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e91c8-1de5-4699-8ee8-54cc3a2b2791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:53.809130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8f2e91c8-1de5-4699-8ee8-54cc3a2b2791 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:53.810379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8f2e91c8-1de5-4699-8ee8-54cc3a2b2791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:53.911095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:54.065494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da60ec-af00-4c64-b3ce-2d5cbb062c57 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:54.067047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-41da60ec-af00-4c64-b3ce-2d5cbb062c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:54.157108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:54.222407 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da60ec-af00-4c64-b3ce-2d5cbb062c57 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:54.342045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a88ef-874d-42c6-9119-a59556caba09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:54.342667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a88ef-874d-42c6-9119-a59556caba09 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:54.343076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a88ef-874d-42c6-9119-a59556caba09 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:54.343350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a88ef-874d-42c6-9119-a59556caba09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:54.344961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8b3a88ef-874d-42c6-9119-a59556caba09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:54.394235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:54.436042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a88ef-874d-42c6-9119-a59556caba09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:54.437735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a88ef-874d-42c6-9119-a59556caba09 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:54.457118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 723/1428] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:55.533302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060add-e806-4750-8f9f-1cfc18e7c670 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:55.533302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060add-e806-4750-8f9f-1cfc18e7c670 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:55.533302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86060add-e806-4750-8f9f-1cfc18e7c670 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:55.535420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:03:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:55.543182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c84f-35fd-4dea-86de-fb554e159feb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:55.544041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c84f-35fd-4dea-86de-fb554e159feb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:55.544041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c84f-35fd-4dea-86de-fb554e159feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:55.629093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8520c84f-35fd-4dea-86de-fb554e159feb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:55.630337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8520c84f-35fd-4dea-86de-fb554e159feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:55.730680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:55.885438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86060add-e806-4750-8f9f-1cfc18e7c670 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:55.887006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-86060add-e806-4750-8f9f-1cfc18e7c670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:55.939970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:56.052649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86060add-e806-4750-8f9f-1cfc18e7c670 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:56.180617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d8b4e-9f67-4395-893f-391b2bf9b8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:56.181298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d8b4e-9f67-4395-893f-391b2bf9b8ee service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:56.181581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d8b4e-9f67-4395-893f-391b2bf9b8ee service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:56.181855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d8b4e-9f67-4395-893f-391b2bf9b8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:56.183480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-015d8b4e-9f67-4395-893f-391b2bf9b8ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:56.190531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:56.277204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d8b4e-9f67-4395-893f-391b2bf9b8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:56.278803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d8b4e-9f67-4395-893f-391b2bf9b8ee service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:56.296983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 707/1431] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:57.344893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1e43d-f9c4-449f-8178-4bcabe90246a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:57.345412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1e43d-f9c4-449f-8178-4bcabe90246a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:57.345412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1e43d-f9c4-449f-8178-4bcabe90246a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:57.346810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:57.353186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e7ee4-48e8-4c72-b43d-4bec8005be51 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:57.353681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e7ee4-48e8-4c72-b43d-4bec8005be51 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:57.353681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e7ee4-48e8-4c72-b43d-4bec8005be51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:57.432217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-748e7ee4-48e8-4c72-b43d-4bec8005be51 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:57.433396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-748e7ee4-48e8-4c72-b43d-4bec8005be51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:57.514907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:57.547225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:57.700716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1e43d-f9c4-449f-8178-4bcabe90246a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:57.702963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bab1e43d-f9c4-449f-8178-4bcabe90246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:57.721947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:57.854662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1e43d-f9c4-449f-8178-4bcabe90246a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:57.946167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:57.973818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53531c9d-1449-435f-aeb8-858590690e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:57.974357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531c9d-1449-435f-aeb8-858590690e97 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:57.974633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531c9d-1449-435f-aeb8-858590690e97 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:57.974903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531c9d-1449-435f-aeb8-858590690e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:57.976512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-53531c9d-1449-435f-aeb8-858590690e97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:58.076219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53531c9d-1449-435f-aeb8-858590690e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:58.077915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53531c9d-1449-435f-aeb8-858590690e97 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:58.096772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 726/1434] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:03:59.212019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd7ec3-fc4f-4e3d-a521-53e50b875a44 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:59.212867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd7ec3-fc4f-4e3d-a521-53e50b875a44 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:59.212967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd7ec3-fc4f-4e3d-a521-53e50b875a44 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:59.215180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:03:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:03:59.221775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cb86-a3b1-404f-9eeb-9eaf19e7cafb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:59.222240 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cb86-a3b1-404f-9eeb-9eaf19e7cafb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:59.222343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cb86-a3b1-404f-9eeb-9eaf19e7cafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:59.300301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-caa0cb86-a3b1-404f-9eeb-9eaf19e7cafb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:03:59.301987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-caa0cb86-a3b1-404f-9eeb-9eaf19e7cafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:59.345195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:59.402801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:03:59.557733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd7ec3-fc4f-4e3d-a521-53e50b875a44 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:03:59.560110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0acd7ec3-fc4f-4e3d-a521-53e50b875a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:59.711097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd7ec3-fc4f-4e3d-a521-53e50b875a44 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:03:59.768146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:03:59.830065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd820673-4470-4e62-bcec-0ca5d48d321f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:03:59.830679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd820673-4470-4e62-bcec-0ca5d48d321f service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:03:59.830971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd820673-4470-4e62-bcec-0ca5d48d321f service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:03:59.831233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd820673-4470-4e62-bcec-0ca5d48d321f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:03:59.832819 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dd820673-4470-4e62-bcec-0ca5d48d321f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:03:59.925415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd820673-4470-4e62-bcec-0ca5d48d321f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:03:59.927013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd820673-4470-4e62-bcec-0ca5d48d321f service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:03:59.945395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 710/1437] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:00.995100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad14c0-5c58-403f-b172-f0203c8cc4e2 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:00.995725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad14c0-5c58-403f-b172-f0203c8cc4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:00.995725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad14c0-5c58-403f-b172-f0203c8cc4e2 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:00.996989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:01.004451 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c618-6a35-48b8-a172-284a14744e74 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:01.004925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c618-6a35-48b8-a172-284a14744e74 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:01.005067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c618-6a35-48b8-a172-284a14744e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:01.093734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6c52c618-6a35-48b8-a172-284a14744e74 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:01.094980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6c52c618-6a35-48b8-a172-284a14744e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:01.097052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:01.207609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:01.357476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad14c0-5c58-403f-b172-f0203c8cc4e2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:01.359718 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b5ad14c0-5c58-403f-b172-f0203c8cc4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:01.519718 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad14c0-5c58-403f-b172-f0203c8cc4e2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:01.555294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:01.647858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b02e38-f803-483e-8022-178610932508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:01.648384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b02e38-f803-483e-8022-178610932508 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:01.648663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b02e38-f803-483e-8022-178610932508 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:01.648937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b02e38-f803-483e-8022-178610932508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:01.650584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-78b02e38-f803-483e-8022-178610932508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:01.754330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b02e38-f803-483e-8022-178610932508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:01.755943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b02e38-f803-483e-8022-178610932508 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:01.775669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 729/1440] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:03.860373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770c5c-0756-4f87-a3aa-83e5c824df4d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:03.860963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770c5c-0756-4f87-a3aa-83e5c824df4d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:03.860963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd770c5c-0756-4f87-a3aa-83e5c824df4d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:03.863054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:03.871364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b707e52-2837-4c2e-a369-2dd8114d1f9d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:03.871800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b707e52-2837-4c2e-a369-2dd8114d1f9d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:03.871934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b707e52-2837-4c2e-a369-2dd8114d1f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:03.914943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:03.940995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2b707e52-2837-4c2e-a369-2dd8114d1f9d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:03.942253 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2b707e52-2837-4c2e-a369-2dd8114d1f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:04.041797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:04.332227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd770c5c-0756-4f87-a3aa-83e5c824df4d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:04.333823 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fd770c5c-0756-4f87-a3aa-83e5c824df4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:04.449575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd770c5c-0756-4f87-a3aa-83e5c824df4d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:04.484294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:04.530466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789c360-9f4f-4ed7-932a-be2590b59e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:04.531077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789c360-9f4f-4ed7-932a-be2590b59e94 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:04.531353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789c360-9f4f-4ed7-932a-be2590b59e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:04.531673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789c360-9f4f-4ed7-932a-be2590b59e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:04.533322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f789c360-9f4f-4ed7-932a-be2590b59e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:04.647364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789c360-9f4f-4ed7-932a-be2590b59e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:04.648804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789c360-9f4f-4ed7-932a-be2590b59e94 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:04.668108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 713/1443] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:07.038591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d67b-8dd9-4048-913c-4e8bd83d8f08 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:07.039198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d67b-8dd9-4048-913c-4e8bd83d8f08 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:07.039198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d67b-8dd9-4048-913c-4e8bd83d8f08 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:07.041255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:04:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:07.049025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eabad-1f46-4893-9e75-3c03d3690de4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:07.049490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eabad-1f46-4893-9e75-3c03d3690de4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:07.049604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eabad-1f46-4893-9e75-3c03d3690de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:07.118808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b98eabad-1f46-4893-9e75-3c03d3690de4 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:07.120008 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b98eabad-1f46-4893-9e75-3c03d3690de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:07.133156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:07.220316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:04:07.511903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9d67b-8dd9-4048-913c-4e8bd83d8f08 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:07.514856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a5d9d67b-8dd9-4048-913c-4e8bd83d8f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:07.625252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9d67b-8dd9-4048-913c-4e8bd83d8f08 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:07.638939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:07.701178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb54be-9e1c-4b2e-80b2-c40dcdd9feb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:07.701793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb54be-9e1c-4b2e-80b2-c40dcdd9feb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:07.702070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb54be-9e1c-4b2e-80b2-c40dcdd9feb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:07.702338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb54be-9e1c-4b2e-80b2-c40dcdd9feb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:07.703939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cacb54be-9e1c-4b2e-80b2-c40dcdd9feb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:07.821769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb54be-9e1c-4b2e-80b2-c40dcdd9feb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:07.823219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb54be-9e1c-4b2e-80b2-c40dcdd9feb3 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:07.841631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 732/1446] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:10.296378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808408d1-176d-4f7b-873d-e293304ba694 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:10.296995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808408d1-176d-4f7b-873d-e293304ba694 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:10.296995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808408d1-176d-4f7b-873d-e293304ba694 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:10.298398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:10.304003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7cc3-4dc4-4a72-9e49-5e977956f915 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:10.304449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7cc3-4dc4-4a72-9e49-5e977956f915 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:10.304560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d7cc3-4dc4-4a72-9e49-5e977956f915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:10.361413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:10.381221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6e5d7cc3-4dc4-4a72-9e49-5e977956f915 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:10.382442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6e5d7cc3-4dc4-4a72-9e49-5e977956f915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:10.481981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:10.769186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808408d1-176d-4f7b-873d-e293304ba694 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:10.771840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-808408d1-176d-4f7b-873d-e293304ba694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:10.885976 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808408d1-176d-4f7b-873d-e293304ba694 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:10.934407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:10.971696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d9e6d-2bd5-4241-addf-cb2f2f231056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:10.972347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d9e6d-2bd5-4241-addf-cb2f2f231056 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:10.972625 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d9e6d-2bd5-4241-addf-cb2f2f231056 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:10.972965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d9e6d-2bd5-4241-addf-cb2f2f231056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:10.974648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef9d9e6d-2bd5-4241-addf-cb2f2f231056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:11.092051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d9e6d-2bd5-4241-addf-cb2f2f231056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:11.093473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d9e6d-2bd5-4241-addf-cb2f2f231056 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:11.111768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 716/1449] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:13.382084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2b52-870b-45b2-88ad-1e1ea49ede1c None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:13.382932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2b52-870b-45b2-88ad-1e1ea49ede1c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:13.382932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2b52-870b-45b2-88ad-1e1ea49ede1c None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:13.385124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:04:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:13.393646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde361d-14c8-44ec-860e-6069bee047eb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:13.394088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde361d-14c8-44ec-860e-6069bee047eb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:13.394088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde361d-14c8-44ec-860e-6069bee047eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:13.462099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cfde361d-14c8-44ec-860e-6069bee047eb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:13.463323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cfde361d-14c8-44ec-860e-6069bee047eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:13.484477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:13.564070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:13.847078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d2b52-870b-45b2-88ad-1e1ea49ede1c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:13.848684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-348d2b52-870b-45b2-88ad-1e1ea49ede1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:13.959275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d2b52-870b-45b2-88ad-1e1ea49ede1c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:13.987891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:14.042657 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21fe21-80f0-4c1f-aef3-a1de09a97f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:14.043296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21fe21-80f0-4c1f-aef3-a1de09a97f82 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:14.043579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21fe21-80f0-4c1f-aef3-a1de09a97f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:14.043849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21fe21-80f0-4c1f-aef3-a1de09a97f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:14.045524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1b21fe21-80f0-4c1f-aef3-a1de09a97f82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:14.169726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21fe21-80f0-4c1f-aef3-a1de09a97f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:14.171183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21fe21-80f0-4c1f-aef3-a1de09a97f82 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:14.189871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 735/1452] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:16.404943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaec319-cd7d-4eac-bac7-967ca7cc2542 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:16.405520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaec319-cd7d-4eac-bac7-967ca7cc2542 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:16.405520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaec319-cd7d-4eac-bac7-967ca7cc2542 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:16.407472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:04:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:16.416508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852823e-0e3f-4728-ba73-2ec7852eacb9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:16.416909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852823e-0e3f-4728-ba73-2ec7852eacb9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:16.417151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852823e-0e3f-4728-ba73-2ec7852eacb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:16.485907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:16.489708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0852823e-0e3f-4728-ba73-2ec7852eacb9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:16.491675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0852823e-0e3f-4728-ba73-2ec7852eacb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:16.596821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:16.877991 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaec319-cd7d-4eac-bac7-967ca7cc2542 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:16.879555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1eaec319-cd7d-4eac-bac7-967ca7cc2542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:16.990802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaec319-cd7d-4eac-bac7-967ca7cc2542 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:17.054766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:17.085621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ea222-6f4a-4f8b-bb77-bceab33c40f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:17.086291 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea222-6f4a-4f8b-bb77-bceab33c40f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:17.086568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea222-6f4a-4f8b-bb77-bceab33c40f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:17.086831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea222-6f4a-4f8b-bb77-bceab33c40f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:17.088443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cc3ea222-6f4a-4f8b-bb77-bceab33c40f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:17.210260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ea222-6f4a-4f8b-bb77-bceab33c40f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:17.211719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ea222-6f4a-4f8b-bb77-bceab33c40f2 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:17.230542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 719/1455] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:19.418399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878f4fc-e8b3-4b50-86f3-58f385aa7b75 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:19.419250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878f4fc-e8b3-4b50-86f3-58f385aa7b75 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:19.419250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878f4fc-e8b3-4b50-86f3-58f385aa7b75 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:19.421559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:04:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:19.427317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b1a2d-0698-42c0-8733-14e73c8b386e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:19.427765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b1a2d-0698-42c0-8733-14e73c8b386e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:19.427869 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b1a2d-0698-42c0-8733-14e73c8b386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:19.514459 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-eb6b1a2d-0698-42c0-8733-14e73c8b386e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:19.516155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eb6b1a2d-0698-42c0-8733-14e73c8b386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:19.551591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:19.623599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:19.902709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878f4fc-e8b3-4b50-86f3-58f385aa7b75 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:19.904288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a878f4fc-e8b3-4b50-86f3-58f385aa7b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:20.027600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878f4fc-e8b3-4b50-86f3-58f385aa7b75 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:20.058206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:20.107151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214cb0b-bc5d-4f27-9c42-d4aa3c5de362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:20.107769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214cb0b-bc5d-4f27-9c42-d4aa3c5de362 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:20.108047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214cb0b-bc5d-4f27-9c42-d4aa3c5de362 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:20.108317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214cb0b-bc5d-4f27-9c42-d4aa3c5de362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:20.110004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a214cb0b-bc5d-4f27-9c42-d4aa3c5de362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:20.224785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214cb0b-bc5d-4f27-9c42-d4aa3c5de362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:20.226255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214cb0b-bc5d-4f27-9c42-d4aa3c5de362 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:20.244860 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 738/1458] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:22.426376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be864-8e33-4982-8221-ac544fa10655 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:22.426908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be864-8e33-4982-8221-ac544fa10655 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:22.426908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be864-8e33-4982-8221-ac544fa10655 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:22.428161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:22.434798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7839be-20fb-4313-998d-527c92338256 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:22.435544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7839be-20fb-4313-998d-527c92338256 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:22.435694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7839be-20fb-4313-998d-527c92338256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:22.512991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3f7839be-20fb-4313-998d-527c92338256 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:22.514260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3f7839be-20fb-4313-998d-527c92338256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:22.523461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:22.616404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:22.898919 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1be864-8e33-4982-8221-ac544fa10655 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:22.900477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ad1be864-8e33-4982-8221-ac544fa10655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:23.016090 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1be864-8e33-4982-8221-ac544fa10655 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:23.091413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:23.117903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba3973-4cdd-4736-a4ee-875154bae849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:23.118525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba3973-4cdd-4736-a4ee-875154bae849 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:23.118819 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba3973-4cdd-4736-a4ee-875154bae849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:23.119078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba3973-4cdd-4736-a4ee-875154bae849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:23.120699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dcba3973-4cdd-4736-a4ee-875154bae849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:23.246609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba3973-4cdd-4736-a4ee-875154bae849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:23.248072 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba3973-4cdd-4736-a4ee-875154bae849 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:23.268299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 722/1461] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:25.446111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60a8d1-6ac2-4bee-8357-acbd55ca63d9 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:25.446748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60a8d1-6ac2-4bee-8357-acbd55ca63d9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:25.446748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60a8d1-6ac2-4bee-8357-acbd55ca63d9 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:25.448028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:25.453918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc7a9c-4cb9-4db5-a38c-5673619b26a8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:25.454342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc7a9c-4cb9-4db5-a38c-5673619b26a8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:25.454455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc7a9c-4cb9-4db5-a38c-5673619b26a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:25.524306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ffcc7a9c-4cb9-4db5-a38c-5673619b26a8 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:25.525983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ffcc7a9c-4cb9-4db5-a38c-5673619b26a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:25.568099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:25.627965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:25.904586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60a8d1-6ac2-4bee-8357-acbd55ca63d9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:25.906977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ec60a8d1-6ac2-4bee-8357-acbd55ca63d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:26.016821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60a8d1-6ac2-4bee-8357-acbd55ca63d9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:26.061065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:26.098180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1711d-31b3-42b2-98c7-f6b3afbdd790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:26.098797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1711d-31b3-42b2-98c7-f6b3afbdd790 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:26.099057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1711d-31b3-42b2-98c7-f6b3afbdd790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:26.099359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1711d-31b3-42b2-98c7-f6b3afbdd790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:26.100973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-67a1711d-31b3-42b2-98c7-f6b3afbdd790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:26.214465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1711d-31b3-42b2-98c7-f6b3afbdd790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:26.215848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1711d-31b3-42b2-98c7-f6b3afbdd790 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:26.234306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 741/1464] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:28.368287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c8381-d750-41b0-bb37-d4c98d6f15ba None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:28.368904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c8381-d750-41b0-bb37-d4c98d6f15ba None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:28.368904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c8381-d750-41b0-bb37-d4c98d6f15ba None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:28.370204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:28.376741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1289cd-ba06-4669-93e9-f93590574b60 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:28.377537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1289cd-ba06-4669-93e9-f93590574b60 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:28.377715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1289cd-ba06-4669-93e9-f93590574b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:28.461151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3b1289cd-ba06-4669-93e9-f93590574b60 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:28.462310 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3b1289cd-ba06-4669-93e9-f93590574b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:28.481016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:28.565402 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:28.845536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c8381-d750-41b0-bb37-d4c98d6f15ba None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:28.847092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bd1c8381-d750-41b0-bb37-d4c98d6f15ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:28.956169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c8381-d750-41b0-bb37-d4c98d6f15ba None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:29.035743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:29.043323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315e5d5-d590-4569-b723-5c488380199d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:29.043977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315e5d5-d590-4569-b723-5c488380199d service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:29.044250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315e5d5-d590-4569-b723-5c488380199d service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:29.044529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315e5d5-d590-4569-b723-5c488380199d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:29.046155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9315e5d5-d590-4569-b723-5c488380199d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:29.164097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315e5d5-d590-4569-b723-5c488380199d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:29.165604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315e5d5-d590-4569-b723-5c488380199d service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:29.185971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 725/1467] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:31.336460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7b05-4917-4585-93e8-b702eb68acc0 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:31.336959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7b05-4917-4585-93e8-b702eb68acc0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:31.337114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b7b05-4917-4585-93e8-b702eb68acc0 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:31.338412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:31.344140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ecf40-9c85-4f79-ab04-90efc3835bd6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:31.344589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ecf40-9c85-4f79-ab04-90efc3835bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:31.344686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ecf40-9c85-4f79-ab04-90efc3835bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:31.414360 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a59ecf40-9c85-4f79-ab04-90efc3835bd6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:31.415475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a59ecf40-9c85-4f79-ab04-90efc3835bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:31.467724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:31.519294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:31.799733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b7b05-4917-4585-93e8-b702eb68acc0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:31.802328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-402b7b05-4917-4585-93e8-b702eb68acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:31.915485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b7b05-4917-4585-93e8-b702eb68acc0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:31.964409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:31.991147 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e3df6-ec1f-466f-8d2b-9341fa726397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:31.991747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e3df6-ec1f-466f-8d2b-9341fa726397 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:31.992025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e3df6-ec1f-466f-8d2b-9341fa726397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:31.992292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e3df6-ec1f-466f-8d2b-9341fa726397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:31.993919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-013e3df6-ec1f-466f-8d2b-9341fa726397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:32.106203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e3df6-ec1f-466f-8d2b-9341fa726397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:32.107572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e3df6-ec1f-466f-8d2b-9341fa726397 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:32.126127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 744/1470] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:41.517615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=22 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:42.123749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=66 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:51.851118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd619ab-fcd1-49f5-9d21-36a5a1af3fa1 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:51.851723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd619ab-fcd1-49f5-9d21-36a5a1af3fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:51.851723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd619ab-fcd1-49f5-9d21-36a5a1af3fa1 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:51.853016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 727/1471] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:51.859646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1812-c51f-488d-ada8-830c0ebd8f16 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:51.860376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1812-c51f-488d-ada8-830c0ebd8f16 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:51.860515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf1812-c51f-488d-ada8-830c0ebd8f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:51.935511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-efbf1812-c51f-488d-ada8-830c0ebd8f16 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:51.936732 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-efbf1812-c51f-488d-ada8-830c0ebd8f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:52.048112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 745/1472] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:52.356267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ae20-77e4-4fab-ac66-d0d8491b04fd None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:52.356630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ae20-77e4-4fab-ac66-d0d8491b04fd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:52.356997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ae20-77e4-4fab-ac66-d0d8491b04fd None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:52.359170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 728/1473] 10.222.0.76 () {54 vars in 962 bytes} [Mon Sep 19 17:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:52.364408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb49f35-d8da-409c-ab7c-7488d99450a8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:52.364690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb49f35-d8da-409c-ab7c-7488d99450a8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:52.364972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb49f35-d8da-409c-ab7c-7488d99450a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:52.444684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0eb49f35-d8da-409c-ab7c-7488d99450a8 None None] MFA Rules not processed for user `2c746178628e4df5961982268e642ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:52.445924 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0eb49f35-d8da-409c-ab7c-7488d99450a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:52.466883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:52.525111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 746/1474] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Sep 19 17:04:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:04:52.533375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79ae20-77e4-4fab-ac66-d0d8491b04fd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:52.534937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4a79ae20-77e4-4fab-ac66-d0d8491b04fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:52.643171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79ae20-77e4-4fab-ac66-d0d8491b04fd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:52.718892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef921035-ee2a-48c5-a3b3-3bc5442933e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c746178628e4df5961982268e642ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:52.719427 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921035-ee2a-48c5-a3b3-3bc5442933e9 service glance] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:52.719701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921035-ee2a-48c5-a3b3-3bc5442933e9 service glance] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:52.719964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921035-ee2a-48c5-a3b3-3bc5442933e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:52.721601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef921035-ee2a-48c5-a3b3-3bc5442933e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:52.781815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:52.838133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef921035-ee2a-48c5-a3b3-3bc5442933e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:52.839579 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef921035-ee2a-48c5-a3b3-3bc5442933e9 service glance] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:52.858487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 729/1475] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:04:55.092322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49629bdc-da51-4a1a-ab4a-94dceb7accad None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:55.093398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49629bdc-da51-4a1a-ab4a-94dceb7accad None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:55.093398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49629bdc-da51-4a1a-ab4a-94dceb7accad None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:55.094729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 747/1476] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:55.100123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8246e-bcc4-43ac-8aad-1b05120d5076 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:55.100553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8246e-bcc4-43ac-8aad-1b05120d5076 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:55.100672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8246e-bcc4-43ac-8aad-1b05120d5076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:55.168861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e5c8246e-bcc4-43ac-8aad-1b05120d5076 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:55.170095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e5c8246e-bcc4-43ac-8aad-1b05120d5076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:55.268953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 730/1477] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:55.537480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49629bdc-da51-4a1a-ab4a-94dceb7accad None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:55.540138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-49629bdc-da51-4a1a-ab4a-94dceb7accad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:55.676326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49629bdc-da51-4a1a-ab4a-94dceb7accad None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:55.734496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:55.781334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f8470-af86-4f80-bf65-b9c31110b79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:55.781982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8470-af86-4f80-bf65-b9c31110b79f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:55.782260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8470-af86-4f80-bf65-b9c31110b79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:55.782569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f8470-af86-4f80-bf65-b9c31110b79f admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:55.783212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f8470-af86-4f80-bf65-b9c31110b79f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:55.784958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-4e5f8470-af86-4f80-bf65-b9c31110b79f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:04:55.784958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 19 17:04:55.784958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: Sep 19 17:04:55.786137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f8470-af86-4f80-bf65-b9c31110b79f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:55.805249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 748/1478] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Sep 19 17:04:55 2022] GET /identity/v3/projects => generated 2553 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:04:57.945414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3585-63c8-4cf7-9cb7-50fb3335a2ff None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:57.946062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3585-63c8-4cf7-9cb7-50fb3335a2ff None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:57.946062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c3585-63c8-4cf7-9cb7-50fb3335a2ff None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:57.947466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 731/1479] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:04:57.953138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80444-e562-4357-bd06-7e4ff8b516c0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:57.953631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80444-e562-4357-bd06-7e4ff8b516c0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:57.953631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80444-e562-4357-bd06-7e4ff8b516c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:58.022950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-43b80444-e562-4357-bd06-7e4ff8b516c0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:04:58.024246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-43b80444-e562-4357-bd06-7e4ff8b516c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:58.122894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 749/1480] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:04:58.415679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c3585-63c8-4cf7-9cb7-50fb3335a2ff None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:04:58.417978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-458c3585-63c8-4cf7-9cb7-50fb3335a2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:58.429992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:58.576092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c3585-63c8-4cf7-9cb7-50fb3335a2ff None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:04:58.664124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:04:58.699692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2954b-0d35-4a66-88f4-8fdb0758db4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:04:58.700303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2954b-0d35-4a66-88f4-8fdb0758db4d service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:04:58.700578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2954b-0d35-4a66-88f4-8fdb0758db4d service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:04:58.700845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2954b-0d35-4a66-88f4-8fdb0758db4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:04:58.702456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0ab2954b-0d35-4a66-88f4-8fdb0758db4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:04:58.805751 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2954b-0d35-4a66-88f4-8fdb0758db4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:04:58.807372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2954b-0d35-4a66-88f4-8fdb0758db4d service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:04:58.826883 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 732/1481] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:05:01.144238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc5b82-592d-439a-902a-6966e67f4c22 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:01.144709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc5b82-592d-439a-902a-6966e67f4c22 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:01.144812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc5b82-592d-439a-902a-6966e67f4c22 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:01.146199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 750/1482] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:05:01.152051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38fd23-860f-46d6-9cb5-f76daa4f8ea0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:01.152568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38fd23-860f-46d6-9cb5-f76daa4f8ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:01.152568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38fd23-860f-46d6-9cb5-f76daa4f8ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:01.228539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2f38fd23-860f-46d6-9cb5-f76daa4f8ea0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:05:01.229795 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2f38fd23-860f-46d6-9cb5-f76daa4f8ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:01.277154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:05:01.330605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 733/1483] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:05:01.618616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc5b82-592d-439a-902a-6966e67f4c22 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:05:01.620197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5afc5b82-592d-439a-902a-6966e67f4c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:01.645549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:05:01.729442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc5b82-592d-439a-902a-6966e67f4c22 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:05:01.810186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b1279-fcb9-4030-878e-19d05559f36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:05:01.810795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1279-fcb9-4030-878e-19d05559f36c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:01.811073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1279-fcb9-4030-878e-19d05559f36c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:01.811345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b1279-fcb9-4030-878e-19d05559f36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:01.813025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-835b1279-fcb9-4030-878e-19d05559f36c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:01.890918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:05:01.926510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b1279-fcb9-4030-878e-19d05559f36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:05:01.927974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b1279-fcb9-4030-878e-19d05559f36c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:05:01.945682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 751/1484] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:05:04.116772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c963a1f-251b-4447-b2e5-f7586c5c69c5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:04.117356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c963a1f-251b-4447-b2e5-f7586c5c69c5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:04.117356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c963a1f-251b-4447-b2e5-f7586c5c69c5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:04.118614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 734/1485] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:05:04.124281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746a386-1a39-47d0-933d-ae22fe9a4c41 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:04.124793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746a386-1a39-47d0-933d-ae22fe9a4c41 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:04.124900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746a386-1a39-47d0-933d-ae22fe9a4c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:04.195442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7746a386-1a39-47d0-933d-ae22fe9a4c41 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:05:04.196667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7746a386-1a39-47d0-933d-ae22fe9a4c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:04.308497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 752/1486] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:05:04.611340 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c963a1f-251b-4447-b2e5-f7586c5c69c5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:05:04.613906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2c963a1f-251b-4447-b2e5-f7586c5c69c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:04.726052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c963a1f-251b-4447-b2e5-f7586c5c69c5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:05:04.803298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:05:04.805134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6ee45-2acb-4743-af7a-abe54bf6252a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:05:04.805834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ee45-2acb-4743-af7a-abe54bf6252a service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:04.806164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ee45-2acb-4743-af7a-abe54bf6252a service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:04.806432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6ee45-2acb-4743-af7a-abe54bf6252a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:04.808863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1cf6ee45-2acb-4743-af7a-abe54bf6252a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:04.927109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6ee45-2acb-4743-af7a-abe54bf6252a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:05:04.928465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6ee45-2acb-4743-af7a-abe54bf6252a service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:05:05.074274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 735/1487] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:05:07.381223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a16530-12a2-4e8d-b747-4928a30fb25e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:07.381726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a16530-12a2-4e8d-b747-4928a30fb25e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:07.381726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a16530-12a2-4e8d-b747-4928a30fb25e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:07.383858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 753/1488] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:05:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:05:07.391925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdd9c5-beb8-440e-9228-db2594e44012 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:07.392367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdd9c5-beb8-440e-9228-db2594e44012 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:07.392471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdd9c5-beb8-440e-9228-db2594e44012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:07.461751 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cffdd9c5-beb8-440e-9228-db2594e44012 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:05:07.463540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cffdd9c5-beb8-440e-9228-db2594e44012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:07.526472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:05:07.573009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 736/1489] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:05:07.869010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a16530-12a2-4e8d-b747-4928a30fb25e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:05:07.870809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-09a16530-12a2-4e8d-b747-4928a30fb25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:07.908348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:05:07.979412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a16530-12a2-4e8d-b747-4928a30fb25e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:05:08.057803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef037cc-b688-4733-a4c5-94dc5364dd69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:05:08.058429 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef037cc-b688-4733-a4c5-94dc5364dd69 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:08.058713 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef037cc-b688-4733-a4c5-94dc5364dd69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:08.058989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef037cc-b688-4733-a4c5-94dc5364dd69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:08.060644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8ef037cc-b688-4733-a4c5-94dc5364dd69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:08.143430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:05:08.173512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef037cc-b688-4733-a4c5-94dc5364dd69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:05:08.174977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef037cc-b688-4733-a4c5-94dc5364dd69 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:05:08.193948 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 754/1490] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:05:10.588563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942254ed-b582-4a59-85a8-3f30c8bec2cc None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:10.589179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942254ed-b582-4a59-85a8-3f30c8bec2cc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:10.589179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942254ed-b582-4a59-85a8-3f30c8bec2cc None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:10.591497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 737/1491] 10.222.0.76 () {54 vars in 927 bytes} [Mon Sep 19 17:05:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:05:10.597779 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79f63e-4024-471c-b301-45929d9e949e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:10.598245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79f63e-4024-471c-b301-45929d9e949e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:10.598351 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79f63e-4024-471c-b301-45929d9e949e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:10.668276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0c79f63e-4024-471c-b301-45929d9e949e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:05:10.669595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0c79f63e-4024-471c-b301-45929d9e949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:10.770689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 755/1492] 10.222.0.76 () {58 vars in 1024 bytes} [Mon Sep 19 17:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:05:11.058020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942254ed-b582-4a59-85a8-3f30c8bec2cc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:05:11.060493 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-942254ed-b582-4a59-85a8-3f30c8bec2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:11.181405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942254ed-b582-4a59-85a8-3f30c8bec2cc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:05:11.268161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040250a4-ac54-4c71-a09d-43a02957a631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:05:11.268781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040250a4-ac54-4c71-a09d-43a02957a631 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:05:11.269069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040250a4-ac54-4c71-a09d-43a02957a631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:05:11.269323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040250a4-ac54-4c71-a09d-43a02957a631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:05:11.270970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-040250a4-ac54-4c71-a09d-43a02957a631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:05:11.280902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:05:11.382433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040250a4-ac54-4c71-a09d-43a02957a631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:05:11.383873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040250a4-ac54-4c71-a09d-43a02957a631 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:05:11.403308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 738/1493] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:05:20.769167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=82 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:05:21.400846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=50 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:23.560531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d811-0997-4053-ae50-1dbf3a1f883a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:23.561182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d811-0997-4053-ae50-1dbf3a1f883a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:23.561182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d811-0997-4053-ae50-1dbf3a1f883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:23.646336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2304d811-0997-4053-ae50-1dbf3a1f883a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:06:23.647479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2304d811-0997-4053-ae50-1dbf3a1f883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:23.761513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 756/1494] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:06:23.770607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6ceb4-8074-4cb6-b82a-86ca38925221 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:23.771149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6ceb4-8074-4cb6-b82a-86ca38925221 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:23.771255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6ceb4-8074-4cb6-b82a-86ca38925221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:23.854204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bfe6ceb4-8074-4cb6-b82a-86ca38925221 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:06:23.855439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bfe6ceb4-8074-4cb6-b82a-86ca38925221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:23.954488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 739/1495] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:06:23.959514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d811-0997-4053-ae50-1dbf3a1f883a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:06:23.960762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2304d811-0997-4053-ae50-1dbf3a1f883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:23.972727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d811-0997-4053-ae50-1dbf3a1f883a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:06:24.063228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:24.098022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:06:24.098673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:24.098959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:24.099231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:24.099888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:06:24.100191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:06:24.101258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:06:24.101258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 19 17:06:24.101258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: Sep 19 17:06:24.102131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:06:24.114450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 757/1496] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:06:24.122895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6ceb4-8074-4cb6-b82a-86ca38925221 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:06:24.132259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6ceb4-8074-4cb6-b82a-86ca38925221 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:06:24.197285 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:24.230525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9988381-80d5-46cc-b464-153c4a509cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:06:24.231140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9988381-80d5-46cc-b464-153c4a509cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:24.231407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9988381-80d5-46cc-b464-153c4a509cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:24.231687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9988381-80d5-46cc-b464-153c4a509cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:24.232295 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9988381-80d5-46cc-b464-153c4a509cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:06:24.234091 dv-cinder-848013-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-f9988381-80d5-46cc-b464-153c4a509cd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:06:24.234091 dv-cinder-848013-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 19 17:06:24.234091 dv-cinder-848013-2-smb devstack@keystone.service[81586]: Sep 19 17:06:24.235280 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9988381-80d5-46cc-b464-153c4a509cd5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:06:24.295497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 740/1497] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:06:24 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:06:24.299872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:06:24.301473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:24.337144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c998d4-735d-4b76-983b-4572ed8a58da admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:06:24.444357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16b04-90be-4367-961e-4645587b6d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:06:24.444975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16b04-90be-4367-961e-4645587b6d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:24.445290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16b04-90be-4367-961e-4645587b6d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:24.445566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16b04-90be-4367-961e-4645587b6d60 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:24.446219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16b04-90be-4367-961e-4645587b6d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:06:24.447248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-b5e16b04-90be-4367-961e-4645587b6d60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:06:24.447248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 19 17:06:24.447248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: Sep 19 17:06:24.448474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16b04-90be-4367-961e-4645587b6d60 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:06:24.504041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 758/1498] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:06:24 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:06:24.508577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9988381-80d5-46cc-b464-153c4a509cd5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:06:24.510157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f9988381-80d5-46cc-b464-153c4a509cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:24.575468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9988381-80d5-46cc-b464-153c4a509cd5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:06:24.663304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:24.675163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa07bc-c3b8-442c-a7f7-643894bfe558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:06:24.675866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa07bc-c3b8-442c-a7f7-643894bfe558 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:24.676145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa07bc-c3b8-442c-a7f7-643894bfe558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:24.676415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa07bc-c3b8-442c-a7f7-643894bfe558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:24.677187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa07bc-c3b8-442c-a7f7-643894bfe558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:06:24.678213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-f7fa07bc-c3b8-442c-a7f7-643894bfe558 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:06:24.678213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 19 17:06:24.678213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: Sep 19 17:06:24.679109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa07bc-c3b8-442c-a7f7-643894bfe558 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:06:24.691539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 741/1499] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:06:24.695949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16b04-90be-4367-961e-4645587b6d60 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:06:24.697520 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b5e16b04-90be-4367-961e-4645587b6d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:24.708903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16b04-90be-4367-961e-4645587b6d60 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:06:24.734495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:24.804654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0c37c-4671-4160-ad08-0c484ef33be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:06:24.805221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0c37c-4671-4160-ad08-0c484ef33be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:24.805503 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0c37c-4671-4160-ad08-0c484ef33be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:24.805773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0c37c-4671-4160-ad08-0c484ef33be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:24.806416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0c37c-4671-4160-ad08-0c484ef33be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:06:24.807433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-eda0c37c-4671-4160-ad08-0c484ef33be5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:06:24.807433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 19 17:06:24.807433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: Sep 19 17:06:24.808357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0c37c-4671-4160-ad08-0c484ef33be5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:06:24.820845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 759/1500] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:06:24.825281 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa07bc-c3b8-442c-a7f7-643894bfe558 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:06:24.826887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f7fa07bc-c3b8-442c-a7f7-643894bfe558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:24.862303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa07bc-c3b8-442c-a7f7-643894bfe558 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:06:24.961087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27d757-34ec-4b25-8a9c-af1e7121623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:06:24.961787 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27d757-34ec-4b25-8a9c-af1e7121623e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:24.962061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27d757-34ec-4b25-8a9c-af1e7121623e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:24.962354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27d757-34ec-4b25-8a9c-af1e7121623e admin admin] PATH_INFO: `/v3/projects/aba4d4dcf0b140bd919ec638f287bbcb/users/d9bc415f91fa484cb553bf385bbefa4f/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:24.984681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27d757-34ec-4b25-8a9c-af1e7121623e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba4d4dcf0b140bd919ec638f287bbcb, user_id=d9bc415f91fa484cb553bf385bbefa4f, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:06:24.985747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-4d27d757-34ec-4b25-8a9c-af1e7121623e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:06:24.985747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 19 17:06:24.985747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: Sep 19 17:06:24.987678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27d757-34ec-4b25-8a9c-af1e7121623e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:06:25.015868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 742/1501] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:06:24 2022] PUT /identity/v3/projects/aba4d4dcf0b140bd919ec638f287bbcb/users/d9bc415f91fa484cb553bf385bbefa4f/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:06:25.028529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad264361-5ca7-49b5-8cae-7337594e277d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:25.028790 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad264361-5ca7-49b5-8cae-7337594e277d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:25.029134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad264361-5ca7-49b5-8cae-7337594e277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:25.099194 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ad264361-5ca7-49b5-8cae-7337594e277d None None] MFA Rules not processed for user `d9bc415f91fa484cb553bf385bbefa4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:06:25.100908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ad264361-5ca7-49b5-8cae-7337594e277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:25.199626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 760/1502] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:06:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:06:25.213713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f030482-0d4a-4322-9dc9-1b8421865f6c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:25.214069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f030482-0d4a-4322-9dc9-1b8421865f6c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:25.214344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f030482-0d4a-4322-9dc9-1b8421865f6c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:25.215730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 743/1503] 10.222.0.76 () {54 vars in 962 bytes} [Mon Sep 19 17:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:06:25.220735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171751a-dd47-4de3-9454-596bfec9c32a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:25.221413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171751a-dd47-4de3-9454-596bfec9c32a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:25.221692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171751a-dd47-4de3-9454-596bfec9c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:25.255557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:25.303321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3171751a-dd47-4de3-9454-596bfec9c32a None None] MFA Rules not processed for user `7338fa9ff18c42f8bc26710ab8376b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:06:25.304706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3171751a-dd47-4de3-9454-596bfec9c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:25.387318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 761/1504] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Sep 19 17:06:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:06:25.395379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f030482-0d4a-4322-9dc9-1b8421865f6c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:06:25.397500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2f030482-0d4a-4322-9dc9-1b8421865f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:25.451882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:25.507250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f030482-0d4a-4322-9dc9-1b8421865f6c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:06:25.589562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df42b0-1327-455f-8da9-beac663f52fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:06:25.590427 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df42b0-1327-455f-8da9-beac663f52fe service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:25.590801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df42b0-1327-455f-8da9-beac663f52fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:25.591209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df42b0-1327-455f-8da9-beac663f52fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:25.593828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d3df42b0-1327-455f-8da9-beac663f52fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:25.709308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df42b0-1327-455f-8da9-beac663f52fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:06:25.710677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df42b0-1327-455f-8da9-beac663f52fe service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:06:25.714169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:25.730599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 744/1505] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:06:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:06:25.777197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca7dcb-aba9-44fa-9d9a-8ab3c9bff77f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:25.777617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca7dcb-aba9-44fa-9d9a-8ab3c9bff77f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:25.777752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca7dcb-aba9-44fa-9d9a-8ab3c9bff77f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:25.779026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 762/1506] 10.222.0.76 () {52 vars in 830 bytes} [Mon Sep 19 17:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:06:25.782884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df42b0-1327-455f-8da9-beac663f52fe service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:06:25.784103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d3df42b0-1327-455f-8da9-beac663f52fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:25.887226 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df42b0-1327-455f-8da9-beac663f52fe service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:06:25.995997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:06:25.996634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:25.996941 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:25.997247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] PATH_INFO: `/v3/users/d9bc415f91fa484cb553bf385bbefa4f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:26.011550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bc415f91fa484cb553bf385bbefa4f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:06:26.012619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:06:26.012619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 19 17:06:26.012619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: Sep 19 17:06:26.013851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:06:26.023653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:26.086229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bc415f91fa484cb553bf385bbefa4f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:06:26.100876 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bc415f91fa484cb553bf385bbefa4f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:06:26.101462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bc415f91fa484cb553bf385bbefa4f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:06:26.112503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bc415f91fa484cb553bf385bbefa4f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:06:26.112943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bc415f91fa484cb553bf385bbefa4f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:06:26.143778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 745/1507] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:06:25 2022] DELETE /identity/v3/users/d9bc415f91fa484cb553bf385bbefa4f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:06:26.148379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3e8e8-2202-43e0-8fb9-df8fbde61ee7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:26.148666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3e8e8-2202-43e0-8fb9-df8fbde61ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:26.148943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3e8e8-2202-43e0-8fb9-df8fbde61ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:26.208722 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c4a3e8e8-2202-43e0-8fb9-df8fbde61ee7 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:06:26.209961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c4a3e8e8-2202-43e0-8fb9-df8fbde61ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:26.287615 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:26.301254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 763/1508] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:06:26.311630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:06:26.312880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:26.419479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9273b4-636f-4c25-8772-27c549cb5e09 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:06:26.478437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:26.501027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71777790-93c6-4be9-ad29-c970cbb727e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:06:26.501741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777790-93c6-4be9-ad29-c970cbb727e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:26.502017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777790-93c6-4be9-ad29-c970cbb727e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:26.502314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71777790-93c6-4be9-ad29-c970cbb727e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:26.503918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-71777790-93c6-4be9-ad29-c970cbb727e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:26.617861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777790-93c6-4be9-ad29-c970cbb727e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:06:26.619227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71777790-93c6-4be9-ad29-c970cbb727e0 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:06:26.638214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 746/1509] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:06:27.000491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3e8e8-2202-43e0-8fb9-df8fbde61ee7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:06:27.001792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c4a3e8e8-2202-43e0-8fb9-df8fbde61ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:06:27.013859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3e8e8-2202-43e0-8fb9-df8fbde61ee7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:06:27.109414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:06:27.110058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:06:27.110336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:06:27.110598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] PATH_INFO: `/v3/projects/aba4d4dcf0b140bd919ec638f287bbcb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:06:27.121636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba4d4dcf0b140bd919ec638f287bbcb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:06:27.122621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:06:27.122621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 19 17:06:27.122621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: Sep 19 17:06:27.123802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:06:27.187179 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba4d4dcf0b140bd919ec638f287bbcb', 'request_id': 'req-26b212bf-7713-49ce-8b35-9696df19e552'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:06:27.194037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba4d4dcf0b140bd919ec638f287bbcb', 'request_id': 'req-26b212bf-7713-49ce-8b35-9696df19e552'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:06:27.204283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba4d4dcf0b140bd919ec638f287bbcb', 'request_id': 'req-26b212bf-7713-49ce-8b35-9696df19e552'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:06:27.233827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] The token cache is being invalidate because project aba4d4dcf0b140bd919ec638f287bbcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:06:27.234117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:06:27.234551 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-26b212bf-7713-49ce-8b35-9696df19e552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:06:27.235960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 764/1510] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:06:26 2022] DELETE /identity/v3/projects/aba4d4dcf0b140bd919ec638f287bbcb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:06:36.635844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=62 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:06:37.231812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:08:01.933151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cb75b-8538-4b79-87a5-b49d6ef6251d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:01.933798 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cb75b-8538-4b79-87a5-b49d6ef6251d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:01.933997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cb75b-8538-4b79-87a5-b49d6ef6251d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:01.936071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:08:01.943353 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f60d3-7bd0-48fd-a9c0-6577f397f4e1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:01.944151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f60d3-7bd0-48fd-a9c0-6577f397f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:01.944358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f60d3-7bd0-48fd-a9c0-6577f397f4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:02.041432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-220f60d3-7bd0-48fd-a9c0-6577f397f4e1 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:08:02.042666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-220f60d3-7bd0-48fd-a9c0-6577f397f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:02.151398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:08:02.324770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cb75b-8538-4b79-87a5-b49d6ef6251d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:08:02.327215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e27cb75b-8538-4b79-87a5-b49d6ef6251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:02.456111 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cb75b-8538-4b79-87a5-b49d6ef6251d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:08:02.462034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b96a3-c617-4f63-b399-8b7db49efa81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:08:02.462638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b96a3-c617-4f63-b399-8b7db49efa81 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:02.462916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b96a3-c617-4f63-b399-8b7db49efa81 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:02.463185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b96a3-c617-4f63-b399-8b7db49efa81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:02.471898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b96a3-c617-4f63-b399-8b7db49efa81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:08:02.474222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b96a3-c617-4f63-b399-8b7db49efa81 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:08:02.487419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 748/1513] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:08:03.569094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b12a0-1fd6-4268-a107-dc7b8b2a7c3e None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:03.569711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b12a0-1fd6-4268-a107-dc7b8b2a7c3e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:03.569711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b12a0-1fd6-4268-a107-dc7b8b2a7c3e None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:03.571020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:08:03.578361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bbe6d-f854-47e8-94e1-aefefc9758d5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:03.578830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bbe6d-f854-47e8-94e1-aefefc9758d5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:03.578947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bbe6d-f854-47e8-94e1-aefefc9758d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:03.606849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-141bbe6d-f854-47e8-94e1-aefefc9758d5 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:08:03.608076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-141bbe6d-f854-47e8-94e1-aefefc9758d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:03.617467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:08:03.767762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b12a0-1fd6-4268-a107-dc7b8b2a7c3e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:08:03.782593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b12a0-1fd6-4268-a107-dc7b8b2a7c3e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:08:03.788143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcc555-1d98-4267-973d-9a60edf43540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:08:03.788742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc555-1d98-4267-973d-9a60edf43540 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:03.789026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc555-1d98-4267-973d-9a60edf43540 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:03.789328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc555-1d98-4267-973d-9a60edf43540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:03.797691 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcc555-1d98-4267-973d-9a60edf43540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:08:03.799273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcc555-1d98-4267-973d-9a60edf43540 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:08:03.806101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c32ea-fcda-4a73-af5b-b6cf50b25492 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:03.806389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c32ea-fcda-4a73-af5b-b6cf50b25492 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:03.806665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c32ea-fcda-4a73-af5b-b6cf50b25492 None None] PATH_INFO: `/v3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:03.808010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 750/1516] 10.222.0.52 () {54 vars in 925 bytes} [Mon Sep 19 17:08:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:08:03.808864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 767/1517] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:08:03.837224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8411864-21d8-42ae-8db8-470ad1bdfbf2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:03.837596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8411864-21d8-42ae-8db8-470ad1bdfbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:03.837936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8411864-21d8-42ae-8db8-470ad1bdfbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:03.910256 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c8411864-21d8-42ae-8db8-470ad1bdfbf2 None None] MFA Rules not processed for user `4716f9539151414dadd9e4b8f13ffc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:08:03.911509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c8411864-21d8-42ae-8db8-470ad1bdfbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:03.969327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:08:03.989900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 751/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Sep 19 17:08:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:08:07.613211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc49ce0-adbd-49f8-a4cb-16f23c4c063f None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:07.613731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc49ce0-adbd-49f8-a4cb-16f23c4c063f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:07.613826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc49ce0-adbd-49f8-a4cb-16f23c4c063f None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:07.615216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 768/1519] 10.222.0.76 () {54 vars in 961 bytes} [Mon Sep 19 17:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:08:07.621205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e324a-a313-4f91-89a0-a56e68ded22e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:07.621746 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e324a-a313-4f91-89a0-a56e68ded22e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:07.621746 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e324a-a313-4f91-89a0-a56e68ded22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:07.643189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c67e324a-a313-4f91-89a0-a56e68ded22e None None] MFA Rules not processed for user `4716f9539151414dadd9e4b8f13ffc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:08:07.644853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c67e324a-a313-4f91-89a0-a56e68ded22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:07.654744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 752/1520] 10.222.0.76 () {58 vars in 1058 bytes} [Mon Sep 19 17:08:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:08:07.662640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc49ce0-adbd-49f8-a4cb-16f23c4c063f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:08:07.677505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc49ce0-adbd-49f8-a4cb-16f23c4c063f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:08:07.683145 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c713e-89a4-46ab-977a-2b949787a530 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4716f9539151414dadd9e4b8f13ffc0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:08:07.683750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c713e-89a4-46ab-977a-2b949787a530 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:07.684027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c713e-89a4-46ab-977a-2b949787a530 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:07.684296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c713e-89a4-46ab-977a-2b949787a530 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:07.692684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c713e-89a4-46ab-977a-2b949787a530 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:08:07.694305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c713e-89a4-46ab-977a-2b949787a530 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:08:07.703780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 769/1521] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:08:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:08:15.293476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d6982-5dfa-4cec-b40f-3b0dc7679d98 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:15.294072 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d6982-5dfa-4cec-b40f-3b0dc7679d98 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:15.294072 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d6982-5dfa-4cec-b40f-3b0dc7679d98 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:15.295502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:08:15.302277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248de1-6539-4142-b636-aecffca6c9d6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:15.302747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248de1-6539-4142-b636-aecffca6c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:15.302853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248de1-6539-4142-b636-aecffca6c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:15.330407 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-47248de1-6539-4142-b636-aecffca6c9d6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:08:15.332022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-47248de1-6539-4142-b636-aecffca6c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:15.340552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:08:15.497431 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d6982-5dfa-4cec-b40f-3b0dc7679d98 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:08:15.514688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d6982-5dfa-4cec-b40f-3b0dc7679d98 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:08:15.520676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b962ad6-7cad-4870-b630-b0818c0cdfef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:08:15.521308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962ad6-7cad-4870-b630-b0818c0cdfef service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:15.521584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962ad6-7cad-4870-b630-b0818c0cdfef service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:15.521852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962ad6-7cad-4870-b630-b0818c0cdfef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:15.530440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b962ad6-7cad-4870-b630-b0818c0cdfef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:08:15.532044 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b962ad6-7cad-4870-b630-b0818c0cdfef service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:08:15.542100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 754/1524] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:08:16.617439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1711e-d66b-43de-aa65-166bf2775379 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:16.618371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1711e-d66b-43de-aa65-166bf2775379 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:16.618371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1711e-d66b-43de-aa65-166bf2775379 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:16.620385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 17:08:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:08:16.626961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464bc02-4401-4713-b2f1-3b08e42422ad None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:16.627393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464bc02-4401-4713-b2f1-3b08e42422ad None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:16.627513 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464bc02-4401-4713-b2f1-3b08e42422ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:16.649284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0464bc02-4401-4713-b2f1-3b08e42422ad None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:08:16.650493 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0464bc02-4401-4713-b2f1-3b08e42422ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:16.659965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 17:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:08:16.816238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1711e-d66b-43de-aa65-166bf2775379 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:08:16.833227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1711e-d66b-43de-aa65-166bf2775379 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:08:16.839242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de78e40-260e-47df-80b1-f8e7a6830b78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:08:16.839837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de78e40-260e-47df-80b1-f8e7a6830b78 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:16.840110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de78e40-260e-47df-80b1-f8e7a6830b78 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:16.840382 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de78e40-260e-47df-80b1-f8e7a6830b78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:16.848666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de78e40-260e-47df-80b1-f8e7a6830b78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:08:16.850279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de78e40-260e-47df-80b1-f8e7a6830b78 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:08:16.859804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 772/1527] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:08:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:08:20.978610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7fbbc-dac0-4eac-9d69-e097705dfa34 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:20.979169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7fbbc-dac0-4eac-9d69-e097705dfa34 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:20.979169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7fbbc-dac0-4eac-9d69-e097705dfa34 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:20.980465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:08:20.986762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3b3b-c2f0-45af-b68c-a4f18655bd1f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:20.987222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3b3b-c2f0-45af-b68c-a4f18655bd1f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:20.987327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c3b3b-c2f0-45af-b68c-a4f18655bd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:21.009188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ed6c3b3b-c2f0-45af-b68c-a4f18655bd1f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:08:21.010394 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ed6c3b3b-c2f0-45af-b68c-a4f18655bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:21.020066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:08:21.310050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7fbbc-dac0-4eac-9d69-e097705dfa34 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:08:21.313365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d0c7fbbc-dac0-4eac-9d69-e097705dfa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:21.400011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7fbbc-dac0-4eac-9d69-e097705dfa34 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:08:21.404517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6da43-b726-4369-bd94-dc25561139db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:08:21.405167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6da43-b726-4369-bd94-dc25561139db service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:21.405453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6da43-b726-4369-bd94-dc25561139db service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:21.405717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6da43-b726-4369-bd94-dc25561139db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:21.415580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6da43-b726-4369-bd94-dc25561139db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:08:21.417019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6da43-b726-4369-bd94-dc25561139db service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:08:21.426804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 757/1530] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:08:23.596133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835aed1-5fa9-4e35-9263-0d7925240d83 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:23.597081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835aed1-5fa9-4e35-9263-0d7925240d83 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:23.597081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835aed1-5fa9-4e35-9263-0d7925240d83 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:23.598625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:08:23.604161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ffb88-0bc0-4426-864f-3749ba8af657 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:23.604578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ffb88-0bc0-4426-864f-3749ba8af657 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:23.604706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ffb88-0bc0-4426-864f-3749ba8af657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:23.624903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-736ffb88-0bc0-4426-864f-3749ba8af657 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:08:23.626155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-736ffb88-0bc0-4426-864f-3749ba8af657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:23.635991 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:08:23.923579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835aed1-5fa9-4e35-9263-0d7925240d83 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:08:23.936506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835aed1-5fa9-4e35-9263-0d7925240d83 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:08:23.940791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2a0991-38d9-4834-8243-08880d112b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:08:23.941462 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a0991-38d9-4834-8243-08880d112b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:23.941740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a0991-38d9-4834-8243-08880d112b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:23.942023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a0991-38d9-4834-8243-08880d112b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:23.952746 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a0991-38d9-4834-8243-08880d112b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:08:23.954212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2a0991-38d9-4834-8243-08880d112b2d service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:08:23.963734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 775/1533] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:08:27.652058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351fd6d-38c3-4472-92c7-b02f08c0f9e1 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:27.652955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351fd6d-38c3-4472-92c7-b02f08c0f9e1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:27.652955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351fd6d-38c3-4472-92c7-b02f08c0f9e1 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:27.655309 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:08:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:08:27.661776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6b742-f41b-43db-aaf9-957f2e018c5b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:27.662511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6b742-f41b-43db-aaf9-957f2e018c5b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:27.662660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6b742-f41b-43db-aaf9-957f2e018c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:27.675178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:08:27.690603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0ea6b742-f41b-43db-aaf9-957f2e018c5b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:08:27.691814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0ea6b742-f41b-43db-aaf9-957f2e018c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:27.700755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:08:28.006750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351fd6d-38c3-4472-92c7-b02f08c0f9e1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:08:28.009377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c351fd6d-38c3-4472-92c7-b02f08c0f9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:28.092281 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351fd6d-38c3-4472-92c7-b02f08c0f9e1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:08:28.096194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e05605-8cca-49d5-9d52-f4f7bd319d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:08:28.096799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e05605-8cca-49d5-9d52-f4f7bd319d17 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:28.097068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e05605-8cca-49d5-9d52-f4f7bd319d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:28.097410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e05605-8cca-49d5-9d52-f4f7bd319d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:28.107591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e05605-8cca-49d5-9d52-f4f7bd319d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:08:28.109065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e05605-8cca-49d5-9d52-f4f7bd319d17 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:08:28.118642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 760/1536] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:08:30.261974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072efc-fb0d-45dc-a45e-7701c3d05683 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:30.262540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072efc-fb0d-45dc-a45e-7701c3d05683 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:30.262540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072efc-fb0d-45dc-a45e-7701c3d05683 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:30.263895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 17:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:08:30.269630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6d4f4-2f0f-4206-84ad-e704d4915813 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:30.270081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6d4f4-2f0f-4206-84ad-e704d4915813 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:30.270194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6d4f4-2f0f-4206-84ad-e704d4915813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:30.291509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-61c6d4f4-2f0f-4206-84ad-e704d4915813 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:08:30.292726 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-61c6d4f4-2f0f-4206-84ad-e704d4915813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:30.301228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 17:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:08:30.607630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac072efc-fb0d-45dc-a45e-7701c3d05683 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:08:30.610615 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ac072efc-fb0d-45dc-a45e-7701c3d05683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:08:30.627354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac072efc-fb0d-45dc-a45e-7701c3d05683 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:08:30.631646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68562623-adca-45d8-879c-359c6ccd402a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:08:30.632248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68562623-adca-45d8-879c-359c6ccd402a service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:08:30.632532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68562623-adca-45d8-879c-359c6ccd402a service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:08:30.632809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68562623-adca-45d8-879c-359c6ccd402a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:08:30.643341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68562623-adca-45d8-879c-359c6ccd402a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:08:30.644880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68562623-adca-45d8-879c-359c6ccd402a service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:08:30.654466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 778/1539] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:08:40.286658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:08:40.650539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=8 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:09:59.655519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49be3e-5446-4b46-995b-37864f19cb55 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:09:59.656225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49be3e-5446-4b46-995b-37864f19cb55 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:09:59.656225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49be3e-5446-4b46-995b-37864f19cb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:09:59.685652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6949-2ebc-4b9c-adab-dbe5577cb1bb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:09:59.686737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6949-2ebc-4b9c-adab-dbe5577cb1bb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:09:59.687273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a6949-2ebc-4b9c-adab-dbe5577cb1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:09:59.694454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ac49be3e-5446-4b46-995b-37864f19cb55 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:09:59.696097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ac49be3e-5446-4b46-995b-37864f19cb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:09:59.707327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 762/1540] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:09:59.721005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04357ef-3956-48c6-a926-efcb39ae0867 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:09:59.721005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04357ef-3956-48c6-a926-efcb39ae0867 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:09:59.721005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04357ef-3956-48c6-a926-efcb39ae0867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:09:59.723368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1a6a6949-2ebc-4b9c-adab-dbe5577cb1bb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:09:59.725422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1a6a6949-2ebc-4b9c-adab-dbe5577cb1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:09:59.740391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 779/1541] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:09:59.749379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11d6cb-00c4-4978-afbc-fa23c0717cf6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:09:59.750047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11d6cb-00c4-4978-afbc-fa23c0717cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:09:59.750574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11d6cb-00c4-4978-afbc-fa23c0717cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:09:59.754034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c04357ef-3956-48c6-a926-efcb39ae0867 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:09:59.755840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c04357ef-3956-48c6-a926-efcb39ae0867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:09:59.768109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 763/1542] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:09:59.773270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04357ef-3956-48c6-a926-efcb39ae0867 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:09:59.782100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4f11d6cb-00c4-4978-afbc-fa23c0717cf6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:09:59.783633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4f11d6cb-00c4-4978-afbc-fa23c0717cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:09:59.792177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04357ef-3956-48c6-a926-efcb39ae0867 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:09:59.799048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 780/1543] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:09:59.802256 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063f3c1-11fa-4347-95e8-34e0a2c5a652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:09:59.803048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063f3c1-11fa-4347-95e8-34e0a2c5a652 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:09:59.803394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063f3c1-11fa-4347-95e8-34e0a2c5a652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:09:59.803737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063f3c1-11fa-4347-95e8-34e0a2c5a652 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:09:59.804257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11d6cb-00c4-4978-afbc-fa23c0717cf6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:09:59.804527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063f3c1-11fa-4347-95e8-34e0a2c5a652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:09:59.804913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063f3c1-11fa-4347-95e8-34e0a2c5a652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:09:59.806038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-f063f3c1-11fa-4347-95e8-34e0a2c5a652 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:09:59.806038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 19 17:09:59.806038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: Sep 19 17:09:59.807031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063f3c1-11fa-4347-95e8-34e0a2c5a652 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:09:59.816081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11d6cb-00c4-4978-afbc-fa23c0717cf6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:09:59.830041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4905fa-60c2-44de-bdea-39ab52f47cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:09:59.831033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4905fa-60c2-44de-bdea-39ab52f47cec admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:09:59.831428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 764/1544] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:09:59.831804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4905fa-60c2-44de-bdea-39ab52f47cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:09:59.832351 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4905fa-60c2-44de-bdea-39ab52f47cec admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:09:59.833418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4905fa-60c2-44de-bdea-39ab52f47cec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:09:59.833949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4905fa-60c2-44de-bdea-39ab52f47cec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:09:59.835837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4905fa-60c2-44de-bdea-39ab52f47cec admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:09:59.843346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063f3c1-11fa-4347-95e8-34e0a2c5a652 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:09:59.865371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 781/1545] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:09:59.866643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063f3c1-11fa-4347-95e8-34e0a2c5a652 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:09:59.868366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4905fa-60c2-44de-bdea-39ab52f47cec admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:09:59.880835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4905fa-60c2-44de-bdea-39ab52f47cec admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:09:59.895995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104584df-7f09-44d0-93c2-4fab08804e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:09:59.901059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104584df-7f09-44d0-93c2-4fab08804e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:09:59.901059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104584df-7f09-44d0-93c2-4fab08804e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:09:59.901059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104584df-7f09-44d0-93c2-4fab08804e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:09:59.901059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104584df-7f09-44d0-93c2-4fab08804e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:09:59.901059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104584df-7f09-44d0-93c2-4fab08804e89 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:09:59.902553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3634f-447e-4abb-a8af-797f7099569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:09:59.903499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3634f-447e-4abb-a8af-797f7099569d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:09:59.904064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3634f-447e-4abb-a8af-797f7099569d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:09:59.904544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3634f-447e-4abb-a8af-797f7099569d admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:09:59.905430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3634f-447e-4abb-a8af-797f7099569d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:09:59.906665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-1ef3634f-447e-4abb-a8af-797f7099569d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:09:59.906665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 19 17:09:59.906665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: Sep 19 17:09:59.908268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3634f-447e-4abb-a8af-797f7099569d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:09:59.974032 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 782/1546] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:09:59 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:09:59.976054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60923c-7d35-47c7-865f-61a16ecf9f36 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:09:59.976546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60923c-7d35-47c7-865f-61a16ecf9f36 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:09:59.977016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60923c-7d35-47c7-865f-61a16ecf9f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:09:59.996991 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 765/1547] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:09:59 2022] POST /identity/v3/projects => generated 391 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:09:59.998326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ac59a-e624-4e70-8e2c-6c05d44dccb4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:09:59.998613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ac59a-e624-4e70-8e2c-6c05d44dccb4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:09:59.998886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ac59a-e624-4e70-8e2c-6c05d44dccb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.013134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5e60923c-7d35-47c7-865f-61a16ecf9f36 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.013134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5e60923c-7d35-47c7-865f-61a16ecf9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.045089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ed5ac59a-e624-4e70-8e2c-6c05d44dccb4 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.046508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ed5ac59a-e624-4e70-8e2c-6c05d44dccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.092058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 783/1548] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.092679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60923c-7d35-47c7-865f-61a16ecf9f36 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.102820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60923c-7d35-47c7-865f-61a16ecf9f36 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.108412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9839734-2579-4500-9f87-750c983ec920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.109051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9839734-2579-4500-9f87-750c983ec920 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.109344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9839734-2579-4500-9f87-750c983ec920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.109614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9839734-2579-4500-9f87-750c983ec920 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.110542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9839734-2579-4500-9f87-750c983ec920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.112997 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9839734-2579-4500-9f87-750c983ec920 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.132883 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 766/1549] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.134272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652509-6091-4514-86c3-994ff2baf7e2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.134555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652509-6091-4514-86c3-994ff2baf7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.134830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652509-6091-4514-86c3-994ff2baf7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.140217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 784/1550] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/users => generated 282 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:00.140981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9839734-2579-4500-9f87-750c983ec920 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.151432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9839734-2579-4500-9f87-750c983ec920 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.156225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e6fc6-0e95-423b-8de4-7f9b9a9d2558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.156831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6fc6-0e95-423b-8de4-7f9b9a9d2558 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.157143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6fc6-0e95-423b-8de4-7f9b9a9d2558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.157440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e6fc6-0e95-423b-8de4-7f9b9a9d2558 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.158064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e6fc6-0e95-423b-8de4-7f9b9a9d2558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.160002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e6fc6-0e95-423b-8de4-7f9b9a9d2558 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.161631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bc652509-6091-4514-86c3-994ff2baf7e2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.162814 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bc652509-6091-4514-86c3-994ff2baf7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.170950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 767/1551] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.174523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f92c-c30f-4eec-959d-cc7fdca869d8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.174847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f92c-c30f-4eec-959d-cc7fdca869d8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.175177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f92c-c30f-4eec-959d-cc7fdca869d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.185067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 785/1552] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:00.186332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98558fd-044c-441c-8d63-f8f36f7039da None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.186627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98558fd-044c-441c-8d63-f8f36f7039da None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.186894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98558fd-044c-441c-8d63-f8f36f7039da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.196712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9766f92c-c30f-4eec-959d-cc7fdca869d8 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.197945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9766f92c-c30f-4eec-959d-cc7fdca869d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.205806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 768/1553] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.206959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e98558fd-044c-441c-8d63-f8f36f7039da None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.208153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e98558fd-044c-441c-8d63-f8f36f7039da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.213929 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76603-d65e-417b-9c76-c65312aa6f26 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.214178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76603-d65e-417b-9c76-c65312aa6f26 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.214458 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76603-d65e-417b-9c76-c65312aa6f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.216562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 786/1554] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.223932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a062b-3281-494f-b17e-e7d5309a91be None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.223932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a062b-3281-494f-b17e-e7d5309a91be None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.223932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a062b-3281-494f-b17e-e7d5309a91be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.235199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9ad76603-d65e-417b-9c76-c65312aa6f26 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.236488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9ad76603-d65e-417b-9c76-c65312aa6f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.239588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-645a062b-3281-494f-b17e-e7d5309a91be None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.240770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-645a062b-3281-494f-b17e-e7d5309a91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.245329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 769/1555] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.246514 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb235b9-a375-462b-957f-0b97b754ab4a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.246780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb235b9-a375-462b-957f-0b97b754ab4a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.247051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb235b9-a375-462b-957f-0b97b754ab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.249697 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 787/1556] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.250578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a062b-3281-494f-b17e-e7d5309a91be None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.261843 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a062b-3281-494f-b17e-e7d5309a91be None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.266848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb96cb-0a3d-4331-8362-e303316e63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.267453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb96cb-0a3d-4331-8362-e303316e63eb admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.267733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb96cb-0a3d-4331-8362-e303316e63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.267990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb96cb-0a3d-4331-8362-e303316e63eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.268644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb96cb-0a3d-4331-8362-e303316e63eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.270291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb96cb-0a3d-4331-8362-e303316e63eb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.271840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8eb235b9-a375-462b-957f-0b97b754ab4a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.273054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8eb235b9-a375-462b-957f-0b97b754ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.280314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 788/1557] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:00.284760 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 770/1558] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.284899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b699-b913-4d71-b875-e7db783263ae None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.284899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b699-b913-4d71-b875-e7db783263ae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.285139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb235b9-a375-462b-957f-0b97b754ab4a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.285234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36b699-b913-4d71-b875-e7db783263ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.294700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb235b9-a375-462b-957f-0b97b754ab4a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.299471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b867646-65e9-4312-97fa-34bd9c92f84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.299987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b867646-65e9-4312-97fa-34bd9c92f84f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.300266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b867646-65e9-4312-97fa-34bd9c92f84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.300536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b867646-65e9-4312-97fa-34bd9c92f84f admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.301208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b867646-65e9-4312-97fa-34bd9c92f84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.301766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7a36b699-b913-4d71-b875-e7db783263ae None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.302834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b867646-65e9-4312-97fa-34bd9c92f84f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.302962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7a36b699-b913-4d71-b875-e7db783263ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.310765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 789/1559] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.311932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f70c8-6fa1-42ea-a771-03934afb91a1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.312212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f70c8-6fa1-42ea-a771-03934afb91a1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.312489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f70c8-6fa1-42ea-a771-03934afb91a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.316140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 771/1560] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:00.316140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71e859-7775-4c97-87ae-ffa317100e60 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.316140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71e859-7775-4c97-87ae-ffa317100e60 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.316140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71e859-7775-4c97-87ae-ffa317100e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.333585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c44f70c8-6fa1-42ea-a771-03934afb91a1 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.334782 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c44f70c8-6fa1-42ea-a771-03934afb91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.335415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3d71e859-7775-4c97-87ae-ffa317100e60 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.336589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3d71e859-7775-4c97-87ae-ffa317100e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.346275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 790/1561] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.346275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f70c8-6fa1-42ea-a771-03934afb91a1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.348020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 772/1562] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.349363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb856ea-e47d-4f48-96ec-91a17f2d0cf7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.349644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb856ea-e47d-4f48-96ec-91a17f2d0cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.349914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb856ea-e47d-4f48-96ec-91a17f2d0cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.356027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f70c8-6fa1-42ea-a771-03934afb91a1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.361278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca67c86-e2fa-44f5-bf27-ca4e60ca5640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.361889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca67c86-e2fa-44f5-bf27-ca4e60ca5640 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.362169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca67c86-e2fa-44f5-bf27-ca4e60ca5640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.362441 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca67c86-e2fa-44f5-bf27-ca4e60ca5640 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.363094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca67c86-e2fa-44f5-bf27-ca4e60ca5640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:00.363396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca67c86-e2fa-44f5-bf27-ca4e60ca5640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.365181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca67c86-e2fa-44f5-bf27-ca4e60ca5640 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.368870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6fb856ea-e47d-4f48-96ec-91a17f2d0cf7 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.370083 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6fb856ea-e47d-4f48-96ec-91a17f2d0cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:00.377367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 791/1563] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:00.378154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca67c86-e2fa-44f5-bf27-ca4e60ca5640 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.378789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 773/1564] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:00.379652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb856ea-e47d-4f48-96ec-91a17f2d0cf7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.390308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb856ea-e47d-4f48-96ec-91a17f2d0cf7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.391110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca67c86-e2fa-44f5-bf27-ca4e60ca5640 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.395646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2eb45a-9fb9-410f-a6a6-361b438d3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.395938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a67f49-0e0f-49ec-9b1e-446ab056ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.396248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb45a-9fb9-410f-a6a6-361b438d3f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.396522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb45a-9fb9-410f-a6a6-361b438d3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.396625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67f49-0e0f-49ec-9b1e-446ab056ff18 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.396785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2eb45a-9fb9-410f-a6a6-361b438d3f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.396888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67f49-0e0f-49ec-9b1e-446ab056ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.397133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67f49-0e0f-49ec-9b1e-446ab056ff18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.397671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2eb45a-9fb9-410f-a6a6-361b438d3f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:00.397844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a67f49-0e0f-49ec-9b1e-446ab056ff18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.398016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2eb45a-9fb9-410f-a6a6-361b438d3f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.399418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a67f49-0e0f-49ec-9b1e-446ab056ff18 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.399593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2eb45a-9fb9-410f-a6a6-361b438d3f87 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.410984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 792/1565] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:00.411898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a67f49-0e0f-49ec-9b1e-446ab056ff18 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.413970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 774/1566] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:00.413970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2eb45a-9fb9-410f-a6a6-361b438d3f87 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.423073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a67f49-0e0f-49ec-9b1e-446ab056ff18 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.427989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75db90-babb-446a-b01b-6c25fb750412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.428634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75db90-babb-446a-b01b-6c25fb750412 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.428915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75db90-babb-446a-b01b-6c25fb750412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.429221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75db90-babb-446a-b01b-6c25fb750412 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.429337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2eb45a-9fb9-410f-a6a6-361b438d3f87 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.429877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75db90-babb-446a-b01b-6c25fb750412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:00.430204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75db90-babb-446a-b01b-6c25fb750412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.431840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75db90-babb-446a-b01b-6c25fb750412 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.433496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:00.434336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5d415-1d95-4637-880d-433b6163b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.435100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5d415-1d95-4637-880d-433b6163b294 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.435354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5d415-1d95-4637-880d-433b6163b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.435650 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5d415-1d95-4637-880d-433b6163b294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.436357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5d415-1d95-4637-880d-433b6163b294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.438071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5d415-1d95-4637-880d-433b6163b294 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.447683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 793/1567] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:00.452647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 775/1568] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:00.452796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75db90-babb-446a-b01b-6c25fb750412 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.452891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5d415-1d95-4637-880d-433b6163b294 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.465127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5d415-1d95-4637-880d-433b6163b294 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.470105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e49b91-4ff7-4d34-92a5-a689d521ec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.470704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e49b91-4ff7-4d34-92a5-a689d521ec71 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.470984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e49b91-4ff7-4d34-92a5-a689d521ec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.471257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e49b91-4ff7-4d34-92a5-a689d521ec71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.471910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e49b91-4ff7-4d34-92a5-a689d521ec71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:00.472215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e49b91-4ff7-4d34-92a5-a689d521ec71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.473900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e49b91-4ff7-4d34-92a5-a689d521ec71 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.475804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75db90-babb-446a-b01b-6c25fb750412 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.480721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667412a8-e3a0-4cd6-934c-a667abe5955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.481352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667412a8-e3a0-4cd6-934c-a667abe5955e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.481631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667412a8-e3a0-4cd6-934c-a667abe5955e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.481910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667412a8-e3a0-4cd6-934c-a667abe5955e admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.482677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667412a8-e3a0-4cd6-934c-a667abe5955e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:00.482977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667412a8-e3a0-4cd6-934c-a667abe5955e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.484563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667412a8-e3a0-4cd6-934c-a667abe5955e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.488555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 776/1569] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:00.489525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e49b91-4ff7-4d34-92a5-a689d521ec71 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.497672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 794/1570] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:00.498549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667412a8-e3a0-4cd6-934c-a667abe5955e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.504130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e49b91-4ff7-4d34-92a5-a689d521ec71 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.509115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667412a8-e3a0-4cd6-934c-a667abe5955e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.509315 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57341e-5da7-4830-adca-921265aa7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.510069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57341e-5da7-4830-adca-921265aa7606 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.510419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57341e-5da7-4830-adca-921265aa7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.510678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57341e-5da7-4830-adca-921265aa7606 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.511453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57341e-5da7-4830-adca-921265aa7606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:00.511750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57341e-5da7-4830-adca-921265aa7606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.513459 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57341e-5da7-4830-adca-921265aa7606 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.514210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b41600-55a0-4b8c-b7fb-8a50dddddd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.514803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b41600-55a0-4b8c-b7fb-8a50dddddd0e admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.515087 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b41600-55a0-4b8c-b7fb-8a50dddddd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.515359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b41600-55a0-4b8c-b7fb-8a50dddddd0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.515986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b41600-55a0-4b8c-b7fb-8a50dddddd0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.517913 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b41600-55a0-4b8c-b7fb-8a50dddddd0e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.525475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 777/1571] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:00.526299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57341e-5da7-4830-adca-921265aa7606 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.531459 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:00.536887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57341e-5da7-4830-adca-921265aa7606 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.542859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5d55-9486-4d24-ae42-0a3f4d368a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.543774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5d55-9486-4d24-ae42-0a3f4d368a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.544048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5d55-9486-4d24-ae42-0a3f4d368a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.544371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5d55-9486-4d24-ae42-0a3f4d368a30 admin admin] PATH_INFO: `/v3/projects/a8655d26be3a4db9a1ebccd57169b537/users/c40a23af46c645b1b7c97253d683f306/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.554115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 795/1572] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:00.554115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b41600-55a0-4b8c-b7fb-8a50dddddd0e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.559963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b5d55-9486-4d24-ae42-0a3f4d368a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8655d26be3a4db9a1ebccd57169b537, user_id=c40a23af46c645b1b7c97253d683f306, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.563327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b5d55-9486-4d24-ae42-0a3f4d368a30 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.576810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 778/1573] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:00 2022] PUT /identity/v3/projects/a8655d26be3a4db9a1ebccd57169b537/users/c40a23af46c645b1b7c97253d683f306/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:00.577705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5d55-9486-4d24-ae42-0a3f4d368a30 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.619238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b41600-55a0-4b8c-b7fb-8a50dddddd0e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.646480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5d55-9486-4d24-ae42-0a3f4d368a30 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.651271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7705e9-beed-4407-943d-9bc96e1c6f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.651939 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7705e9-beed-4407-943d-9bc96e1c6f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.652219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7705e9-beed-4407-943d-9bc96e1c6f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.652494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7705e9-beed-4407-943d-9bc96e1c6f9e admin admin] PATH_INFO: `/v3/projects/2ffb1146669b4d0fa34a117d378d30cd/users/2b29780489334bb6807674a8c4ea5239/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.666980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7705e9-beed-4407-943d-9bc96e1c6f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffb1146669b4d0fa34a117d378d30cd, user_id=2b29780489334bb6807674a8c4ea5239, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.669809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7705e9-beed-4407-943d-9bc96e1c6f9e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.675331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e9116-4c51-4b38-8bd5-69e0b7672148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.675996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e9116-4c51-4b38-8bd5-69e0b7672148 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.676276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e9116-4c51-4b38-8bd5-69e0b7672148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.676557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e9116-4c51-4b38-8bd5-69e0b7672148 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.677278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e9116-4c51-4b38-8bd5-69e0b7672148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.679180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e9116-4c51-4b38-8bd5-69e0b7672148 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.682885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 779/1574] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:00 2022] PUT /identity/v3/projects/2ffb1146669b4d0fa34a117d378d30cd/users/2b29780489334bb6807674a8c4ea5239/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:00.686732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7705e9-beed-4407-943d-9bc96e1c6f9e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.709907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 796/1575] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:00.713933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e9116-4c51-4b38-8bd5-69e0b7672148 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.747728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7705e9-beed-4407-943d-9bc96e1c6f9e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.786611 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:00.805867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e9116-4c51-4b38-8bd5-69e0b7672148 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.809829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3929c-4d60-4406-895d-63b3d6c56c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.810496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3929c-4d60-4406-895d-63b3d6c56c99 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.810708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3929c-4d60-4406-895d-63b3d6c56c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.810975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3929c-4d60-4406-895d-63b3d6c56c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.811619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3929c-4d60-4406-895d-63b3d6c56c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.813597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3929c-4d60-4406-895d-63b3d6c56c99 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.814318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835a736-7bf5-4a28-8d82-2f2442bb38b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.814932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a736-7bf5-4a28-8d82-2f2442bb38b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.815210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a736-7bf5-4a28-8d82-2f2442bb38b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.815475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835a736-7bf5-4a28-8d82-2f2442bb38b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.816102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835a736-7bf5-4a28-8d82-2f2442bb38b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.818120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835a736-7bf5-4a28-8d82-2f2442bb38b7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.828837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:00.845268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 780/1576] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:00.846087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3929c-4d60-4406-895d-63b3d6c56c99 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.846616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 797/1577] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:00.847315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835a736-7bf5-4a28-8d82-2f2442bb38b7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.911899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3929c-4d60-4406-895d-63b3d6c56c99 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.913676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835a736-7bf5-4a28-8d82-2f2442bb38b7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:00.916600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01fa43-dad1-472c-af75-8f6a0bdcffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.917335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01fa43-dad1-472c-af75-8f6a0bdcffb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.917638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01fa43-dad1-472c-af75-8f6a0bdcffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.917909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01fa43-dad1-472c-af75-8f6a0bdcffb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.918571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01fa43-dad1-472c-af75-8f6a0bdcffb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.918684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0c7bd-9ef3-4c3a-99b9-7917cba51496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:00.919306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0c7bd-9ef3-4c3a-99b9-7917cba51496 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.919592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0c7bd-9ef3-4c3a-99b9-7917cba51496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.919874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0c7bd-9ef3-4c3a-99b9-7917cba51496 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.920492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01fa43-dad1-472c-af75-8f6a0bdcffb5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.920619 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0c7bd-9ef3-4c3a-99b9-7917cba51496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:00.922446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0c7bd-9ef3-4c3a-99b9-7917cba51496 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:00.948207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 781/1578] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:00.952292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01fa43-dad1-472c-af75-8f6a0bdcffb5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:00.952427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 798/1579] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:00.952427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4540a36-0a85-4ae2-9872-ddc386006c7c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:00.952427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4540a36-0a85-4ae2-9872-ddc386006c7c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:00.952427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4540a36-0a85-4ae2-9872-ddc386006c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:00.978199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e4540a36-0a85-4ae2-9872-ddc386006c7c None None] MFA Rules not processed for user `c40a23af46c645b1b7c97253d683f306`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:00.979398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e4540a36-0a85-4ae2-9872-ddc386006c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:01.014988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01fa43-dad1-472c-af75-8f6a0bdcffb5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.042679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 799/1580] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:01.044085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f3f4f-10e6-40df-ab7f-550ad99bb67e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.044382 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f3f4f-10e6-40df-ab7f-550ad99bb67e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.044680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f3f4f-10e6-40df-ab7f-550ad99bb67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.063861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-782f3f4f-10e6-40df-ab7f-550ad99bb67e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:01.065024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-782f3f4f-10e6-40df-ab7f-550ad99bb67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:01.073189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6870cbb-0cf6-4ef3-8394-aae855c2710f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.073885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870cbb-0cf6-4ef3-8394-aae855c2710f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.074243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870cbb-0cf6-4ef3-8394-aae855c2710f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.074581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870cbb-0cf6-4ef3-8394-aae855c2710f admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.075276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6870cbb-0cf6-4ef3-8394-aae855c2710f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.076382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-c6870cbb-0cf6-4ef3-8394-aae855c2710f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:10:01.076382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 19 17:10:01.076382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: Sep 19 17:10:01.077801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6870cbb-0cf6-4ef3-8394-aae855c2710f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.099749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 782/1581] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:00 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:01.100642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6870cbb-0cf6-4ef3-8394-aae855c2710f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.110228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6870cbb-0cf6-4ef3-8394-aae855c2710f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.114982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0074e-d643-4e28-b920-36634696f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.115683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:01.115808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0074e-d643-4e28-b920-36634696f75e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.116014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0074e-d643-4e28-b920-36634696f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.116347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0074e-d643-4e28-b920-36634696f75e admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.117064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0074e-d643-4e28-b920-36634696f75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.119533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0074e-d643-4e28-b920-36634696f75e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.139048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:01.140252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 800/1582] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:01.141250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f3f4f-10e6-40df-ab7f-550ad99bb67e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.147492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 783/1583] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:01 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:01.148332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0074e-d643-4e28-b920-36634696f75e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.159577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f3f4f-10e6-40df-ab7f-550ad99bb67e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.164853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124f82e-3c6e-4250-87a6-349fe63a42a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.165570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124f82e-3c6e-4250-87a6-349fe63a42a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.165842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124f82e-3c6e-4250-87a6-349fe63a42a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.166105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124f82e-3c6e-4250-87a6-349fe63a42a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.166728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124f82e-3c6e-4250-87a6-349fe63a42a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.168680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124f82e-3c6e-4250-87a6-349fe63a42a6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.168931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0074e-d643-4e28-b920-36634696f75e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.175863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c6f0-b5d9-4b5b-ad14-b00f5ab21a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.176922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c6f0-b5d9-4b5b-ad14-b00f5ab21a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.177372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c6f0-b5d9-4b5b-ad14-b00f5ab21a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.177799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c6f0-b5d9-4b5b-ad14-b00f5ab21a68 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.178777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5c6f0-b5d9-4b5b-ad14-b00f5ab21a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.181922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5c6f0-b5d9-4b5b-ad14-b00f5ab21a68 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.191649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 801/1584] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:01 2022] POST /identity/v3/users => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:01.191649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124f82e-3c6e-4250-87a6-349fe63a42a6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.208577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124f82e-3c6e-4250-87a6-349fe63a42a6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.213971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 784/1585] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:01 2022] POST /identity/v3/users => generated 284 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:01.213971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c6f0-b5d9-4b5b-ad14-b00f5ab21a68 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.214573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a313be-46d6-49fd-a2db-9aac31016383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.215188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a313be-46d6-49fd-a2db-9aac31016383 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.215454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a313be-46d6-49fd-a2db-9aac31016383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.215728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a313be-46d6-49fd-a2db-9aac31016383 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.216588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a313be-46d6-49fd-a2db-9aac31016383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.218593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a313be-46d6-49fd-a2db-9aac31016383 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.221639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c6f0-b5d9-4b5b-ad14-b00f5ab21a68 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.226265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff52fb-a6f6-40b3-9f11-fd81a0afe198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.226864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff52fb-a6f6-40b3-9f11-fd81a0afe198 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.227137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff52fb-a6f6-40b3-9f11-fd81a0afe198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.227403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff52fb-a6f6-40b3-9f11-fd81a0afe198 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.228051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff52fb-a6f6-40b3-9f11-fd81a0afe198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.230407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff52fb-a6f6-40b3-9f11-fd81a0afe198 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.244028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 802/1586] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:01 2022] POST /identity/v3/users => generated 302 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:01.244028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a313be-46d6-49fd-a2db-9aac31016383 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.252062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a313be-46d6-49fd-a2db-9aac31016383 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.257464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 785/1587] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:01 2022] POST /identity/v3/users => generated 285 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:01.257943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2afb22-e0cd-4e01-9d78-65244042adc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.258289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff52fb-a6f6-40b3-9f11-fd81a0afe198 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.258796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2afb22-e0cd-4e01-9d78-65244042adc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.259149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2afb22-e0cd-4e01-9d78-65244042adc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.259507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2afb22-e0cd-4e01-9d78-65244042adc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.260207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2afb22-e0cd-4e01-9d78-65244042adc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.262238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2afb22-e0cd-4e01-9d78-65244042adc2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.268114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff52fb-a6f6-40b3-9f11-fd81a0afe198 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.273165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1717e7-49dd-4b0c-97bb-0a64be4eec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.273579 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1717e7-49dd-4b0c-97bb-0a64be4eec43 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.273858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1717e7-49dd-4b0c-97bb-0a64be4eec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.274128 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1717e7-49dd-4b0c-97bb-0a64be4eec43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.274806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1717e7-49dd-4b0c-97bb-0a64be4eec43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.276355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1717e7-49dd-4b0c-97bb-0a64be4eec43 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.287735 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 786/1588] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.288538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1717e7-49dd-4b0c-97bb-0a64be4eec43 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.292209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 803/1589] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:01 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:01.293323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2afb22-e0cd-4e01-9d78-65244042adc2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.295559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4b2afb22-e0cd-4e01-9d78-65244042adc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:01.298138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1717e7-49dd-4b0c-97bb-0a64be4eec43 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.353852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2afb22-e0cd-4e01-9d78-65244042adc2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.355411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d776-fe14-4824-9278-5539d6d0d36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.356076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d776-fe14-4824-9278-5539d6d0d36a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.356359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d776-fe14-4824-9278-5539d6d0d36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.356632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d776-fe14-4824-9278-5539d6d0d36a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.357314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118d776-fe14-4824-9278-5539d6d0d36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.357816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88f2e-85b9-4bf6-98a5-094f6f90cca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.358454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88f2e-85b9-4bf6-98a5-094f6f90cca7 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.358733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88f2e-85b9-4bf6-98a5-094f6f90cca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.358916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118d776-fe14-4824-9278-5539d6d0d36a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.359046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88f2e-85b9-4bf6-98a5-094f6f90cca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.368493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd88f2e-85b9-4bf6-98a5-094f6f90cca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.368886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 787/1590] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.369710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d776-fe14-4824-9278-5539d6d0d36a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.373209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd88f2e-85b9-4bf6-98a5-094f6f90cca7 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.379141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d776-fe14-4824-9278-5539d6d0d36a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.383266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 804/1591] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:01.383955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88f2e-85b9-4bf6-98a5-094f6f90cca7 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.385326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfb8cd-b224-4212-8ede-a7381ba2def5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.385945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfb8cd-b224-4212-8ede-a7381ba2def5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.386258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfb8cd-b224-4212-8ede-a7381ba2def5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.386490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfb8cd-b224-4212-8ede-a7381ba2def5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.387187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfb8cd-b224-4212-8ede-a7381ba2def5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.388733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfb8cd-b224-4212-8ede-a7381ba2def5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.393399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88f2e-85b9-4bf6-98a5-094f6f90cca7 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.398902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150e157-b714-4942-98c4-b57cfefebb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.399507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150e157-b714-4942-98c4-b57cfefebb62 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.399785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150e157-b714-4942-98c4-b57cfefebb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.400055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150e157-b714-4942-98c4-b57cfefebb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.400689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150e157-b714-4942-98c4-b57cfefebb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.400801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 788/1592] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.402690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150e157-b714-4942-98c4-b57cfefebb62 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.404730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfb8cd-b224-4212-8ede-a7381ba2def5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.413507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 805/1593] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.414342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150e157-b714-4942-98c4-b57cfefebb62 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.415849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfb8cd-b224-4212-8ede-a7381ba2def5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.421582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5730d7-f9fb-4f96-b739-0b5faeb5f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.422212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5730d7-f9fb-4f96-b739-0b5faeb5f663 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.422485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5730d7-f9fb-4f96-b739-0b5faeb5f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.422736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5730d7-f9fb-4f96-b739-0b5faeb5f663 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.423382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5730d7-f9fb-4f96-b739-0b5faeb5f663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.424565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150e157-b714-4942-98c4-b57cfefebb62 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.424989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5730d7-f9fb-4f96-b739-0b5faeb5f663 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.429990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc50571-abb7-4272-a904-e83bda1dceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.430598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50571-abb7-4272-a904-e83bda1dceea admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.430878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50571-abb7-4272-a904-e83bda1dceea admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.431151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50571-abb7-4272-a904-e83bda1dceea admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.431850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc50571-abb7-4272-a904-e83bda1dceea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.433982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc50571-abb7-4272-a904-e83bda1dceea admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.439527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 789/1594] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.440646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5730d7-f9fb-4f96-b739-0b5faeb5f663 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.447084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 806/1595] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.448303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc50571-abb7-4272-a904-e83bda1dceea admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.452201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5730d7-f9fb-4f96-b739-0b5faeb5f663 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.458046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33518-1a59-4775-94c4-70e32e26c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.458694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33518-1a59-4775-94c4-70e32e26c02e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.458977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33518-1a59-4775-94c4-70e32e26c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.459250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c33518-1a59-4775-94c4-70e32e26c02e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.460086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c33518-1a59-4775-94c4-70e32e26c02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.460206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc50571-abb7-4272-a904-e83bda1dceea admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.461744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c33518-1a59-4775-94c4-70e32e26c02e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.465675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770013aa-baf5-496b-aa84-96e3aaa4822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.466284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770013aa-baf5-496b-aa84-96e3aaa4822d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.466563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770013aa-baf5-496b-aa84-96e3aaa4822d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.466849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770013aa-baf5-496b-aa84-96e3aaa4822d admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.468116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770013aa-baf5-496b-aa84-96e3aaa4822d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.470363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770013aa-baf5-496b-aa84-96e3aaa4822d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.472913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 790/1596] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.474400 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33518-1a59-4775-94c4-70e32e26c02e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.486698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c33518-1a59-4775-94c4-70e32e26c02e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.492179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed084738-1354-42a1-80cd-91bfb2f7c0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.492805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed084738-1354-42a1-80cd-91bfb2f7c0ff admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.493200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed084738-1354-42a1-80cd-91bfb2f7c0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.493478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed084738-1354-42a1-80cd-91bfb2f7c0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.494141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed084738-1354-42a1-80cd-91bfb2f7c0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.496119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed084738-1354-42a1-80cd-91bfb2f7c0ff admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.499628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 807/1597] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:01 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:01.501052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770013aa-baf5-496b-aa84-96e3aaa4822d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.516809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 791/1598] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.516809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed084738-1354-42a1-80cd-91bfb2f7c0ff admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.517699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770013aa-baf5-496b-aa84-96e3aaa4822d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.524059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99585-b2bc-4a19-9868-d2187babb465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.524483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99585-b2bc-4a19-9868-d2187babb465 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.524864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99585-b2bc-4a19-9868-d2187babb465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.525049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed084738-1354-42a1-80cd-91bfb2f7c0ff admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.525270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99585-b2bc-4a19-9868-d2187babb465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.525986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d99585-b2bc-4a19-9868-d2187babb465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.527696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d99585-b2bc-4a19-9868-d2187babb465 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.530730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73980-bca5-4553-b7d1-9884339e4b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.531510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73980-bca5-4553-b7d1-9884339e4b45 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.531827 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73980-bca5-4553-b7d1-9884339e4b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.532215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f73980-bca5-4553-b7d1-9884339e4b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.533003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f73980-bca5-4553-b7d1-9884339e4b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.534670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f73980-bca5-4553-b7d1-9884339e4b45 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.543107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 808/1599] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.543107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99585-b2bc-4a19-9868-d2187babb465 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.549206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 792/1600] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.549206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73980-bca5-4553-b7d1-9884339e4b45 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.553675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99585-b2bc-4a19-9868-d2187babb465 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.559488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ee368-642c-420a-afa7-0dfc3c607903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.560013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ee368-642c-420a-afa7-0dfc3c607903 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.560289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ee368-642c-420a-afa7-0dfc3c607903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.560559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ee368-642c-420a-afa7-0dfc3c607903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.560760 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f73980-bca5-4553-b7d1-9884339e4b45 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.561238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ee368-642c-420a-afa7-0dfc3c607903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.562910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ee368-642c-420a-afa7-0dfc3c607903 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.566433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b47e6-4328-4d33-9e98-5772caa54f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.567521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b47e6-4328-4d33-9e98-5772caa54f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.568179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b47e6-4328-4d33-9e98-5772caa54f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.569099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b47e6-4328-4d33-9e98-5772caa54f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.569887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b47e6-4328-4d33-9e98-5772caa54f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.571601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b47e6-4328-4d33-9e98-5772caa54f94 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.574056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 809/1601] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.578049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ee368-642c-420a-afa7-0dfc3c607903 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.593057 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 793/1602] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.593057 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b47e6-4328-4d33-9e98-5772caa54f94 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.600850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b47e6-4328-4d33-9e98-5772caa54f94 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.602520 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ee368-642c-420a-afa7-0dfc3c607903 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.606698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13852c50-d9c8-4979-a098-499cbf1d7e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.607339 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13852c50-d9c8-4979-a098-499cbf1d7e3f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.607680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13852c50-d9c8-4979-a098-499cbf1d7e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.608044 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13852c50-d9c8-4979-a098-499cbf1d7e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.608759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13852c50-d9c8-4979-a098-499cbf1d7e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.609211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131acf8-c990-41a9-90f8-ae615f5fdf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.616133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131acf8-c990-41a9-90f8-ae615f5fdf5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.617011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131acf8-c990-41a9-90f8-ae615f5fdf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.617335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13852c50-d9c8-4979-a098-499cbf1d7e3f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.617691 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131acf8-c990-41a9-90f8-ae615f5fdf5c admin admin] PATH_INFO: `/v3/projects/8fa3b89a2f0a4d359ecef6b6e558f40e/users/041507d810424dd7b34bff2e347bd52a/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.629059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 794/1603] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:01.629954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13852c50-d9c8-4979-a098-499cbf1d7e3f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.640916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131acf8-c990-41a9-90f8-ae615f5fdf5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa3b89a2f0a4d359ecef6b6e558f40e, user_id=041507d810424dd7b34bff2e347bd52a, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.642023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-a131acf8-c990-41a9-90f8-ae615f5fdf5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:10:01.642023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 19 17:10:01.642023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: Sep 19 17:10:01.643963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131acf8-c990-41a9-90f8-ae615f5fdf5c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.645242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13852c50-d9c8-4979-a098-499cbf1d7e3f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.651457 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3f44-f64f-40bc-ace0-994d4dced46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.652350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3f44-f64f-40bc-ace0-994d4dced46e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.652832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3f44-f64f-40bc-ace0-994d4dced46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.653428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3f44-f64f-40bc-ace0-994d4dced46e admin admin] PATH_INFO: `/v3/projects/cb5b1cefb5bc4270a0e2cbfc1d5fe12a/users/2058cf92a0c844f2bb81f9c50f13106d/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.658418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 810/1604] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:01 2022] PUT /identity/v3/projects/8fa3b89a2f0a4d359ecef6b6e558f40e/users/041507d810424dd7b34bff2e347bd52a/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:01.659228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131acf8-c990-41a9-90f8-ae615f5fdf5c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.671192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e3f44-f64f-40bc-ace0-994d4dced46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5b1cefb5bc4270a0e2cbfc1d5fe12a, user_id=2058cf92a0c844f2bb81f9c50f13106d, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.673711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:01.674017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e3f44-f64f-40bc-ace0-994d4dced46e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.690577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 795/1605] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:01 2022] PUT /identity/v3/projects/cb5b1cefb5bc4270a0e2cbfc1d5fe12a/users/2058cf92a0c844f2bb81f9c50f13106d/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:01.691283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3f44-f64f-40bc-ace0-994d4dced46e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.709983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:01.733749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131acf8-c990-41a9-90f8-ae615f5fdf5c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.775216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3f44-f64f-40bc-ace0-994d4dced46e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.781163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ab493-0c84-4890-83d6-fbae12327799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.782476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ab493-0c84-4890-83d6-fbae12327799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.782476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ab493-0c84-4890-83d6-fbae12327799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.782476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ab493-0c84-4890-83d6-fbae12327799 admin admin] PATH_INFO: `/v3/projects/94a23a7a236d481a92d501a2a23ee617/users/f46936e5244744e3b0c849e4506bb88c/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.803448 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ab493-0c84-4890-83d6-fbae12327799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a23a7a236d481a92d501a2a23ee617, user_id=f46936e5244744e3b0c849e4506bb88c, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.806664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ab493-0c84-4890-83d6-fbae12327799 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.808868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb6dd-2e3d-4157-aae8-6ef4abc7ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.810042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb6dd-2e3d-4157-aae8-6ef4abc7ab50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.810669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb6dd-2e3d-4157-aae8-6ef4abc7ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.811013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb6dd-2e3d-4157-aae8-6ef4abc7ab50 admin admin] PATH_INFO: `/v3/projects/4a45f62732c04e2ca257d4f9904c04d8/users/58005342342744a98bbfe8ed97ad151b/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.831015 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 796/1606] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:01 2022] PUT /identity/v3/projects/94a23a7a236d481a92d501a2a23ee617/users/f46936e5244744e3b0c849e4506bb88c/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:01.832838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ab493-0c84-4890-83d6-fbae12327799 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.835815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bb6dd-2e3d-4157-aae8-6ef4abc7ab50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a45f62732c04e2ca257d4f9904c04d8, user_id=58005342342744a98bbfe8ed97ad151b, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.838740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bb6dd-2e3d-4157-aae8-6ef4abc7ab50 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.865400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 811/1607] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:01 2022] PUT /identity/v3/projects/4a45f62732c04e2ca257d4f9904c04d8/users/58005342342744a98bbfe8ed97ad151b/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:01.866275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb6dd-2e3d-4157-aae8-6ef4abc7ab50 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:01.907979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ab493-0c84-4890-83d6-fbae12327799 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.943463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb6dd-2e3d-4157-aae8-6ef4abc7ab50 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:01.949018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce3add-26c3-478e-94eb-07a2bd2b9e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.950425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce3add-26c3-478e-94eb-07a2bd2b9e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.950425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce3add-26c3-478e-94eb-07a2bd2b9e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.950425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce3add-26c3-478e-94eb-07a2bd2b9e91 admin admin] PATH_INFO: `/v3/projects/cd0e3ec5903e460b8af76efcb0e3c15a/users/7478d0a5e2cd41fe9a83573c426d3091/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.967035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce3add-26c3-478e-94eb-07a2bd2b9e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0e3ec5903e460b8af76efcb0e3c15a, user_id=7478d0a5e2cd41fe9a83573c426d3091, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:01.969775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce3add-26c3-478e-94eb-07a2bd2b9e91 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:01.974058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2e59-39a0-4836-9bab-6e5e1aff206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:01.974709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2e59-39a0-4836-9bab-6e5e1aff206c admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:01.974986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2e59-39a0-4836-9bab-6e5e1aff206c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:01.975253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2e59-39a0-4836-9bab-6e5e1aff206c admin admin] PATH_INFO: `/v3/projects/8dc5eb16d7ed497e8a83cf8f297c1d65/users/b4084d8e5cfd451894524d5003dcb6c8/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:01.997062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 812/1608] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:01 2022] PUT /identity/v3/projects/cd0e3ec5903e460b8af76efcb0e3c15a/users/7478d0a5e2cd41fe9a83573c426d3091/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:01.997062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce3add-26c3-478e-94eb-07a2bd2b9e91 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:02.006590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2e59-39a0-4836-9bab-6e5e1aff206c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc5eb16d7ed497e8a83cf8f297c1d65, user_id=b4084d8e5cfd451894524d5003dcb6c8, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:02.009947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2e59-39a0-4836-9bab-6e5e1aff206c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:02.028012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 797/1609] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:01 2022] PUT /identity/v3/projects/8dc5eb16d7ed497e8a83cf8f297c1d65/users/b4084d8e5cfd451894524d5003dcb6c8/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:02.029856 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd60e4-83e7-4ad4-ad75-351aa85b3c10 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.030173 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd60e4-83e7-4ad4-ad75-351aa85b3c10 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.030471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd60e4-83e7-4ad4-ad75-351aa85b3c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.042451 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:02.058233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-31dd60e4-83e7-4ad4-ad75-351aa85b3c10 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:02.060949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-31dd60e4-83e7-4ad4-ad75-351aa85b3c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:02.077099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:02.088986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce3add-26c3-478e-94eb-07a2bd2b9e91 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:02.149524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 798/1610] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:02.149524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ce811-80a1-4ded-9153-b0a5be90a02e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.149524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ce811-80a1-4ded-9153-b0a5be90a02e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.149524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ce811-80a1-4ded-9153-b0a5be90a02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.169882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5952a-1ec0-4b49-bb30-8f8baffa74bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:02.170573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5952a-1ec0-4b49-bb30-8f8baffa74bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.170854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5952a-1ec0-4b49-bb30-8f8baffa74bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.171598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5952a-1ec0-4b49-bb30-8f8baffa74bf admin admin] PATH_INFO: `/v3/projects/1c1cb3edbec24bcca72651b5214f8374/users/a5aecb3232f54efe84dab40e40baf9d2/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.188659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f85ce811-80a1-4ded-9153-b0a5be90a02e None None] MFA Rules not processed for user `2058cf92a0c844f2bb81f9c50f13106d`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:02.189942 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f85ce811-80a1-4ded-9153-b0a5be90a02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:02.195220 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5952a-1ec0-4b49-bb30-8f8baffa74bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1cb3edbec24bcca72651b5214f8374, user_id=a5aecb3232f54efe84dab40e40baf9d2, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:02.198524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5952a-1ec0-4b49-bb30-8f8baffa74bf admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:02.220999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 813/1611] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:01 2022] PUT /identity/v3/projects/1c1cb3edbec24bcca72651b5214f8374/users/a5aecb3232f54efe84dab40e40baf9d2/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:02.222922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b6da-dd85-4992-bb2e-c2c151ad6956 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.223269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b6da-dd85-4992-bb2e-c2c151ad6956 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.223648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2b6da-dd85-4992-bb2e-c2c151ad6956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.262840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a5b2b6da-dd85-4992-bb2e-c2c151ad6956 None None] MFA Rules not processed for user `f46936e5244744e3b0c849e4506bb88c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:02.264203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a5b2b6da-dd85-4992-bb2e-c2c151ad6956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:02.283397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 799/1612] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:02.285318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eadb02-308b-4651-a0d9-fa35cf7431b0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.285688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eadb02-308b-4651-a0d9-fa35cf7431b0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.286162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eadb02-308b-4651-a0d9-fa35cf7431b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.316273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-52eadb02-308b-4651-a0d9-fa35cf7431b0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:02.318097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-52eadb02-308b-4651-a0d9-fa35cf7431b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:02.340828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 814/1613] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:02.342607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc96a92-dcb7-420f-9ee2-14028ac98277 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.342986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc96a92-dcb7-420f-9ee2-14028ac98277 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.343394 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc96a92-dcb7-420f-9ee2-14028ac98277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.380687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bfc96a92-dcb7-420f-9ee2-14028ac98277 None None] MFA Rules not processed for user `7478d0a5e2cd41fe9a83573c426d3091`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:02.382771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bfc96a92-dcb7-420f-9ee2-14028ac98277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:02.402755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 800/1614] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:02.404215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d76a6-f4b1-4402-ad24-84da8e92d8a8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.404500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d76a6-f4b1-4402-ad24-84da8e92d8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.404989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d76a6-f4b1-4402-ad24-84da8e92d8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.429209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:02.439155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-501d76a6-f4b1-4402-ad24-84da8e92d8a8 None None] MFA Rules not processed for user `b4084d8e5cfd451894524d5003dcb6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:02.440450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-501d76a6-f4b1-4402-ad24-84da8e92d8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:02.471631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 815/1615] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:02.472655 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc96a92-dcb7-420f-9ee2-14028ac98277 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:02.504578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:02.536726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc96a92-dcb7-420f-9ee2-14028ac98277 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:02.541189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dab48c-e251-4f0b-a998-70994c62e2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:02.542033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dab48c-e251-4f0b-a998-70994c62e2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.542486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dab48c-e251-4f0b-a998-70994c62e2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.542927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dab48c-e251-4f0b-a998-70994c62e2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.553980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dab48c-e251-4f0b-a998-70994c62e2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:02.555780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dab48c-e251-4f0b-a998-70994c62e2c5 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:02.566137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 801/1616] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:02.566803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d76a6-f4b1-4402-ad24-84da8e92d8a8 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:02.568433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 816/1617] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:02.569511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dab48c-e251-4f0b-a998-70994c62e2c5 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:02.580570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dab48c-e251-4f0b-a998-70994c62e2c5 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:02.586209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a6a17-a368-49bb-8460-e746ad89fac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:02.586595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d76a6-f4b1-4402-ad24-84da8e92d8a8 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:02.587358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a6a17-a368-49bb-8460-e746ad89fac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.587866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a6a17-a368-49bb-8460-e746ad89fac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.588341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a6a17-a368-49bb-8460-e746ad89fac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.589260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a6a17-a368-49bb-8460-e746ad89fac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:02.591445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a6a17-a368-49bb-8460-e746ad89fac3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:02.592328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9e845-a0b9-402a-9545-6231df73f399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:02.593275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9e845-a0b9-402a-9545-6231df73f399 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.593504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9e845-a0b9-402a-9545-6231df73f399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.593784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9e845-a0b9-402a-9545-6231df73f399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.595011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9e845-a0b9-402a-9545-6231df73f399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:02.597673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca9e845-a0b9-402a-9545-6231df73f399 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:02.612020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 802/1618] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:02.613732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9e845-a0b9-402a-9545-6231df73f399 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:02.645200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 817/1619] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:02 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:02.645200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a6a17-a368-49bb-8460-e746ad89fac3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:02.711144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9e845-a0b9-402a-9545-6231df73f399 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:02.754367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a6a17-a368-49bb-8460-e746ad89fac3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:02.766809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2302ae6-f7c0-4b3e-af36-9c89477db3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:02.767581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302ae6-f7c0-4b3e-af36-9c89477db3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.767968 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302ae6-f7c0-4b3e-af36-9c89477db3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.768344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302ae6-f7c0-4b3e-af36-9c89477db3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.816666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe66677-9d53-4153-9632-408498423ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:02.817375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe66677-9d53-4153-9632-408498423ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.818065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe66677-9d53-4153-9632-408498423ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.819794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe66677-9d53-4153-9632-408498423ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.887230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2302ae6-f7c0-4b3e-af36-9c89477db3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:02.890192 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2302ae6-f7c0-4b3e-af36-9c89477db3f4 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:02.909665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 818/1620] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:02.911178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2958f2-0ed0-497b-a418-f013801f8eb2 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.911572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2958f2-0ed0-497b-a418-f013801f8eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.911946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2958f2-0ed0-497b-a418-f013801f8eb2 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.918079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 819/1621] 10.222.0.76 () {54 vars in 965 bytes} [Mon Sep 19 17:10:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:10:02.919081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2958f2-0ed0-497b-a418-f013801f8eb2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:02.929852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:02.930461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe66677-9d53-4153-9632-408498423ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:02.931913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe66677-9d53-4153-9632-408498423ef1 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:02.936964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2958f2-0ed0-497b-a418-f013801f8eb2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:02.947191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fff898-7ae0-4d37-9c63-87309971a3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:02.948792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fff898-7ae0-4d37-9c63-87309971a3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.949456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fff898-7ae0-4d37-9c63-87309971a3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.949963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fff898-7ae0-4d37-9c63-87309971a3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.950819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fff898-7ae0-4d37-9c63-87309971a3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:02.955482 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fff898-7ae0-4d37-9c63-87309971a3c6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:02.962422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 803/1622] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:02.963504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe66677-9d53-4153-9632-408498423ef1 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:02.979607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe66677-9d53-4153-9632-408498423ef1 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:02.989290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddb249-a3f1-4768-abbd-c84f1f870d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:02.990524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb249-a3f1-4768-abbd-c84f1f870d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:02.991034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb249-a3f1-4768-abbd-c84f1f870d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:02.991541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddb249-a3f1-4768-abbd-c84f1f870d21 admin admin] PATH_INFO: `/v3/projects/1c1cb3edbec24bcca72651b5214f8374/users/a5aecb3232f54efe84dab40e40baf9d2/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:02.995638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddb249-a3f1-4768-abbd-c84f1f870d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1cb3edbec24bcca72651b5214f8374, user_id=a5aecb3232f54efe84dab40e40baf9d2, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:03.002656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddb249-a3f1-4768-abbd-c84f1f870d21 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:03.022196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 820/1623] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:02 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:03.026560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fff898-7ae0-4d37-9c63-87309971a3c6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:03.055968 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 804/1624] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:02 2022] PUT /identity/v3/projects/1c1cb3edbec24bcca72651b5214f8374/users/a5aecb3232f54efe84dab40e40baf9d2/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:03.057801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2e903-627e-4ed1-8afc-c39716b1ea96 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:03.058325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2e903-627e-4ed1-8afc-c39716b1ea96 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:03.058853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2e903-627e-4ed1-8afc-c39716b1ea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:03.143884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fff898-7ae0-4d37-9c63-87309971a3c6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:03.144108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-46e2e903-627e-4ed1-8afc-c39716b1ea96 None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:03.145502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-46e2e903-627e-4ed1-8afc-c39716b1ea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:03.160176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:03.280229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980dc26-37b3-47a9-ac60-45d2cebb65d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:03.281243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980dc26-37b3-47a9-ac60-45d2cebb65d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:03.281363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 805/1625] 10.222.0.76 () {58 vars in 1062 bytes} [Mon Sep 19 17:10:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:03.282218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2e903-627e-4ed1-8afc-c39716b1ea96 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:03.282427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980dc26-37b3-47a9-ac60-45d2cebb65d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:03.284290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980dc26-37b3-47a9-ac60-45d2cebb65d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:03.285217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980dc26-37b3-47a9-ac60-45d2cebb65d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:03.291571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980dc26-37b3-47a9-ac60-45d2cebb65d3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:03.297198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2e903-627e-4ed1-8afc-c39716b1ea96 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:03.303967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca4881-2d92-4786-b46a-2d90250503f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:03.304808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca4881-2d92-4786-b46a-2d90250503f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:03.305422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca4881-2d92-4786-b46a-2d90250503f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:03.305738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca4881-2d92-4786-b46a-2d90250503f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:03.306436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca4881-2d92-4786-b46a-2d90250503f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:03.309312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca4881-2d92-4786-b46a-2d90250503f8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:03.327399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 821/1626] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:03 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:03.343638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e157eb-4078-47dd-92d8-7a1823645fc8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:03.344681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e157eb-4078-47dd-92d8-7a1823645fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:03.345045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 806/1627] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:03 2022] POST /identity/v3/users => generated 308 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:03.345468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e157eb-4078-47dd-92d8-7a1823645fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:03.349132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca4881-2d92-4786-b46a-2d90250503f8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:03.368480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca4881-2d92-4786-b46a-2d90250503f8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:03.415423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-68e157eb-4078-47dd-92d8-7a1823645fc8 None None] MFA Rules not processed for user `a5aecb3232f54efe84dab40e40baf9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:03.415423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-68e157eb-4078-47dd-92d8-7a1823645fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:03.443306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78541036-dbfe-4b5f-b699-7c4253a8b77c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:03.443306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78541036-dbfe-4b5f-b699-7c4253a8b77c service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:03.443306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78541036-dbfe-4b5f-b699-7c4253a8b77c service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:03.443306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78541036-dbfe-4b5f-b699-7c4253a8b77c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:03.560190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78541036-dbfe-4b5f-b699-7c4253a8b77c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:03.561894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78541036-dbfe-4b5f-b699-7c4253a8b77c service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:03.591115 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 807/1628] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:03.600103 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 822/1629] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:03.601749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e157eb-4078-47dd-92d8-7a1823645fc8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:03.615033 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78541036-dbfe-4b5f-b699-7c4253a8b77c service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:03.618905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:03.627497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e157eb-4078-47dd-92d8-7a1823645fc8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:03.641630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd95531-b71a-4b2c-a5b3-dea6c44add82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:03.641630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd95531-b71a-4b2c-a5b3-dea6c44add82 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:03.641630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd95531-b71a-4b2c-a5b3-dea6c44add82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:03.642299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd95531-b71a-4b2c-a5b3-dea6c44add82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:03.642767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd95531-b71a-4b2c-a5b3-dea6c44add82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:03.645818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd95531-b71a-4b2c-a5b3-dea6c44add82 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:03.665739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78541036-dbfe-4b5f-b699-7c4253a8b77c service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:03.673829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a742de3-7275-4f36-9428-aa2c1d4b250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:03.674462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a742de3-7275-4f36-9428-aa2c1d4b250c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:03.674744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a742de3-7275-4f36-9428-aa2c1d4b250c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:03.675022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a742de3-7275-4f36-9428-aa2c1d4b250c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:03.675684 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a742de3-7275-4f36-9428-aa2c1d4b250c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:03.677419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a742de3-7275-4f36-9428-aa2c1d4b250c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:03.684393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 823/1630] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:03.686125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd95531-b71a-4b2c-a5b3-dea6c44add82 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:03.700071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 808/1631] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:03.702267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a742de3-7275-4f36-9428-aa2c1d4b250c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:03.742168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a742de3-7275-4f36-9428-aa2c1d4b250c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:03.761869 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131ca69-83db-49b1-bdc6-3d2210190441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:03.762563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131ca69-83db-49b1-bdc6-3d2210190441 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:03.762862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131ca69-83db-49b1-bdc6-3d2210190441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:03.763277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131ca69-83db-49b1-bdc6-3d2210190441 admin admin] PATH_INFO: `/v3/projects/72ecd197c6784d6ab0f377ad0d8811e3/users/05c3fcdca030450a89aa6aa8af411417/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:03.770678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd95531-b71a-4b2c-a5b3-dea6c44add82 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:03.775376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe204e-ae4b-4d78-b81d-1917d135585d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:03.776305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe204e-ae4b-4d78-b81d-1917d135585d service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:03.776932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe204e-ae4b-4d78-b81d-1917d135585d service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:03.777384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe204e-ae4b-4d78-b81d-1917d135585d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:03.804876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe204e-ae4b-4d78-b81d-1917d135585d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:03.806390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131ca69-83db-49b1-bdc6-3d2210190441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ecd197c6784d6ab0f377ad0d8811e3, user_id=05c3fcdca030450a89aa6aa8af411417, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:03.807792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe204e-ae4b-4d78-b81d-1917d135585d service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:03.809357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131ca69-83db-49b1-bdc6-3d2210190441 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:03.825127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 824/1632] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:03.825814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe204e-ae4b-4d78-b81d-1917d135585d service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:03.846773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 809/1633] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:03 2022] PUT /identity/v3/projects/72ecd197c6784d6ab0f377ad0d8811e3/users/05c3fcdca030450a89aa6aa8af411417/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:03.851893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131ca69-83db-49b1-bdc6-3d2210190441 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:03.856407 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe204e-ae4b-4d78-b81d-1917d135585d service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:03.989365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068383-a575-4c1b-b558-2237b42208f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:03.990066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068383-a575-4c1b-b558-2237b42208f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:03.990347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068383-a575-4c1b-b558-2237b42208f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:03.990624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15068383-a575-4c1b-b558-2237b42208f8 admin admin] PATH_INFO: `/v3/projects/b2ba8a4f85bf4d7181554cf0c25023e4/users/5e35f9ce832843ecb042d86f7650f55a/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:04.028967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:04.048193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068383-a575-4c1b-b558-2237b42208f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ba8a4f85bf4d7181554cf0c25023e4, user_id=5e35f9ce832843ecb042d86f7650f55a, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:04.051296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15068383-a575-4c1b-b558-2237b42208f8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:04.077097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131ca69-83db-49b1-bdc6-3d2210190441 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:04.089535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 825/1634] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:03 2022] PUT /identity/v3/projects/b2ba8a4f85bf4d7181554cf0c25023e4/users/5e35f9ce832843ecb042d86f7650f55a/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:04.094396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068383-a575-4c1b-b558-2237b42208f8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:04.109702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409ba16-32b4-4194-9884-38d01c49d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:04.121918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409ba16-32b4-4194-9884-38d01c49d9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:04.122282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409ba16-32b4-4194-9884-38d01c49d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:04.122563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409ba16-32b4-4194-9884-38d01c49d9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:04.123297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409ba16-32b4-4194-9884-38d01c49d9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:04.124992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409ba16-32b4-4194-9884-38d01c49d9e0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:04.195549 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 810/1635] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:10:04.196498 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409ba16-32b4-4194-9884-38d01c49d9e0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:04.221812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409ba16-32b4-4194-9884-38d01c49d9e0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:04.345023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15068383-a575-4c1b-b558-2237b42208f8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:04.357213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9853e-5a6b-4af5-8a62-eb458afc625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:04.357977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9853e-5a6b-4af5-8a62-eb458afc625f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:04.359466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9853e-5a6b-4af5-8a62-eb458afc625f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:04.362051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9853e-5a6b-4af5-8a62-eb458afc625f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:04.370787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9853e-5a6b-4af5-8a62-eb458afc625f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:04.372946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9853e-5a6b-4af5-8a62-eb458afc625f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:04.382116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e451c-7e57-4b59-bf00-5367d34950c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:04.383136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e451c-7e57-4b59-bf00-5367d34950c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:04.383136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e451c-7e57-4b59-bf00-5367d34950c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:04.383333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e451c-7e57-4b59-bf00-5367d34950c3 admin admin] PATH_INFO: `/v3/projects/72ecd197c6784d6ab0f377ad0d8811e3/users/05c3fcdca030450a89aa6aa8af411417/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:04.391320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 826/1636] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:04.391514 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e451c-7e57-4b59-bf00-5367d34950c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ecd197c6784d6ab0f377ad0d8811e3, user_id=05c3fcdca030450a89aa6aa8af411417, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:04.392751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273ab34-3da2-4aad-8e3c-f7bbc86a9ac8 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:04.393056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273ab34-3da2-4aad-8e3c-f7bbc86a9ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:04.393347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273ab34-3da2-4aad-8e3c-f7bbc86a9ac8 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:04.394202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e451c-7e57-4b59-bf00-5367d34950c3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:04.399654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 827/1637] 10.222.0.76 () {54 vars in 912 bytes} [Mon Sep 19 17:10:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:10:04.400449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273ab34-3da2-4aad-8e3c-f7bbc86a9ac8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:04.444577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 811/1638] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:04 2022] PUT /identity/v3/projects/72ecd197c6784d6ab0f377ad0d8811e3/users/05c3fcdca030450a89aa6aa8af411417/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:04.446059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77324f-b1e9-4b29-b4a5-08aee8a6f144 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:04.446345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77324f-b1e9-4b29-b4a5-08aee8a6f144 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:04.446621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77324f-b1e9-4b29-b4a5-08aee8a6f144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:04.462633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273ab34-3da2-4aad-8e3c-f7bbc86a9ac8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:04.498124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ff77324f-b1e9-4b29-b4a5-08aee8a6f144 None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:04.500670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ff77324f-b1e9-4b29-b4a5-08aee8a6f144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:04.520398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:04.628795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91302991-0997-4f06-82a2-fa4697ceac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:04.628795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91302991-0997-4f06-82a2-fa4697ceac59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:04.628979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91302991-0997-4f06-82a2-fa4697ceac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:04.629204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91302991-0997-4f06-82a2-fa4697ceac59 admin admin] PATH_INFO: `/v3/projects/b2ba8a4f85bf4d7181554cf0c25023e4/users/5e35f9ce832843ecb042d86f7650f55a/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:04.632656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91302991-0997-4f06-82a2-fa4697ceac59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ba8a4f85bf4d7181554cf0c25023e4, user_id=5e35f9ce832843ecb042d86f7650f55a, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:04.635978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91302991-0997-4f06-82a2-fa4697ceac59 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:04.667461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 812/1639] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:10:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:04.669704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1ee99-dee5-4e8e-9228-969ba9ee54a4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:04.670642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1ee99-dee5-4e8e-9228-969ba9ee54a4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:04.670642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1ee99-dee5-4e8e-9228-969ba9ee54a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:04.693374 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 828/1640] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:04 2022] PUT /identity/v3/projects/b2ba8a4f85bf4d7181554cf0c25023e4/users/5e35f9ce832843ecb042d86f7650f55a/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:04.707665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0091e88-36b4-46e7-9aaf-d9c9364c6792 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:04.708804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0091e88-36b4-46e7-9aaf-d9c9364c6792 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:04.709577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0091e88-36b4-46e7-9aaf-d9c9364c6792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:04.735133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-eef1ee99-dee5-4e8e-9228-969ba9ee54a4 None None] MFA Rules not processed for user `05c3fcdca030450a89aa6aa8af411417`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:04.736687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eef1ee99-dee5-4e8e-9228-969ba9ee54a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:04.760142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a0091e88-36b4-46e7-9aaf-d9c9364c6792 None None] MFA Rules not processed for user `5e35f9ce832843ecb042d86f7650f55a`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:04.762168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a0091e88-36b4-46e7-9aaf-d9c9364c6792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:04.948131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 829/1641] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:04.949221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0091e88-36b4-46e7-9aaf-d9c9364c6792 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:04.960229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:04.977445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 813/1642] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:04 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:04.977445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1ee99-dee5-4e8e-9228-969ba9ee54a4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:05.089173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0091e88-36b4-46e7-9aaf-d9c9364c6792 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:05.096538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27227-062a-4285-9298-984b904e65f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:05.098077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27227-062a-4285-9298-984b904e65f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:05.098365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27227-062a-4285-9298-984b904e65f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:05.098715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d27227-062a-4285-9298-984b904e65f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:05.118655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1ee99-dee5-4e8e-9228-969ba9ee54a4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:05.133338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:05.134174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:05.134646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:05.135682 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] PATH_INFO: `/v3/users/c40a23af46c645b1b7c97253d683f306` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:05.139844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40a23af46c645b1b7c97253d683f306)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:05.145413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:05.212236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:05.268461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d27227-062a-4285-9298-984b904e65f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:05.270686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d27227-062a-4285-9298-984b904e65f2 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:05.280941 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40a23af46c645b1b7c97253d683f306'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:05.288855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 830/1643] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:05.289766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27227-062a-4285-9298-984b904e65f2 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:05.298897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d27227-062a-4285-9298-984b904e65f2 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:05.303227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20fe37-8427-4bb5-a3b9-455780f7492d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:05.303907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20fe37-8427-4bb5-a3b9-455780f7492d service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:05.304195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20fe37-8427-4bb5-a3b9-455780f7492d service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:05.304518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20fe37-8427-4bb5-a3b9-455780f7492d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:05.305943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40a23af46c645b1b7c97253d683f306'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:05.308139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40a23af46c645b1b7c97253d683f306'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:05.316867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20fe37-8427-4bb5-a3b9-455780f7492d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:05.318671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20fe37-8427-4bb5-a3b9-455780f7492d service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:05.336879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40a23af46c645b1b7c97253d683f306'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:05.338426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-774f3088-d4fa-4226-b552-998634de0c06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40a23af46c645b1b7c97253d683f306'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:05.344632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 831/1644] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:05.392223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 814/1645] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:04 2022] DELETE /identity/v3/users/c40a23af46c645b1b7c97253d683f306 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:05.393813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff4181-70bd-4882-ad30-abc7f1c9c566 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:05.394187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff4181-70bd-4882-ad30-abc7f1c9c566 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:05.394526 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff4181-70bd-4882-ad30-abc7f1c9c566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:05.395187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20fe37-8427-4bb5-a3b9-455780f7492d service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:05.407573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20fe37-8427-4bb5-a3b9-455780f7492d service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:05.419846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ddff4181-70bd-4882-ad30-abc7f1c9c566 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:05.421200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ddff4181-70bd-4882-ad30-abc7f1c9c566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:05.523493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015d6c6-2f48-4560-a062-3abf0f622f53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:05.524051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015d6c6-2f48-4560-a062-3abf0f622f53 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:05.524332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015d6c6-2f48-4560-a062-3abf0f622f53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:05.524602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015d6c6-2f48-4560-a062-3abf0f622f53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:05.529291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8015d6c6-2f48-4560-a062-3abf0f622f53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:05.541942 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 815/1646] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:05.549327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff4181-70bd-4882-ad30-abc7f1c9c566 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:05.553339 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ddff4181-70bd-4882-ad30-abc7f1c9c566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:05.611689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:05.703904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff4181-70bd-4882-ad30-abc7f1c9c566 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:05.717335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360fe3c-8f1a-4705-9d9f-b48b42ab41d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:05.718110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360fe3c-8f1a-4705-9d9f-b48b42ab41d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:05.718893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360fe3c-8f1a-4705-9d9f-b48b42ab41d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:05.720377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360fe3c-8f1a-4705-9d9f-b48b42ab41d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:05.727715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015d6c6-2f48-4560-a062-3abf0f622f53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:05.730060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015d6c6-2f48-4560-a062-3abf0f622f53 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:05.744461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360fe3c-8f1a-4705-9d9f-b48b42ab41d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:05.748361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360fe3c-8f1a-4705-9d9f-b48b42ab41d1 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:05.755588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 832/1647] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:05 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:10:05.776944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 816/1648] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:06.486258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13153314-5fa6-4d52-a51f-476ef3481e88 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:06.486900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13153314-5fa6-4d52-a51f-476ef3481e88 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:06.486900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13153314-5fa6-4d52-a51f-476ef3481e88 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:06.488953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 833/1649] 10.222.0.76 () {54 vars in 965 bytes} [Mon Sep 19 17:10:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 17:10:06.498509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261385f-9128-4fe3-96e9-f8d8e0fe1a27 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:06.499065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261385f-9128-4fe3-96e9-f8d8e0fe1a27 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:06.499065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261385f-9128-4fe3-96e9-f8d8e0fe1a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:06.538540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1261385f-9128-4fe3-96e9-f8d8e0fe1a27 None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:06.542387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1261385f-9128-4fe3-96e9-f8d8e0fe1a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:06.730628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13153314-5fa6-4d52-a51f-476ef3481e88 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:06.732522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-13153314-5fa6-4d52-a51f-476ef3481e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:06.785453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13153314-5fa6-4d52-a51f-476ef3481e88 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:06.788720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 817/1650] 10.222.0.76 () {58 vars in 1062 bytes} [Mon Sep 19 17:10:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:06.792494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:06.794391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b53c5-5239-41f4-948d-da88f97c56d5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:06.794503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b53c5-5239-41f4-948d-da88f97c56d5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:06.794735 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b53c5-5239-41f4-948d-da88f97c56d5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:06.796374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 818/1651] 10.222.0.76 () {54 vars in 912 bytes} [Mon Sep 19 17:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 17:10:06.797165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:06.797244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:06.797452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] PATH_INFO: `/v3/users/b4084d8e5cfd451894524d5003dcb6c8` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:06.798889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4084d8e5cfd451894524d5003dcb6c8)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:06.800236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: WARNING py.warnings [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:10:06.800236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: warnings.warn(msg) Sep 19 17:10:06.800236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: Sep 19 17:10:06.802719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402bbe9-6745-4a40-ae83-c9b1fdce792e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:06.803144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402bbe9-6745-4a40-ae83-c9b1fdce792e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:06.803546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402bbe9-6745-4a40-ae83-c9b1fdce792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:06.807719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:06.852205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1402bbe9-6745-4a40-ae83-c9b1fdce792e None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:06.856887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1402bbe9-6745-4a40-ae83-c9b1fdce792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:06.879593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 819/1652] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:10:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:06.895115 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402bbe9-6745-4a40-ae83-c9b1fdce792e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:06.896587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1402bbe9-6745-4a40-ae83-c9b1fdce792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:06.911050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402bbe9-6745-4a40-ae83-c9b1fdce792e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:06.915718 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaed8b3-992b-4901-80e7-2f55aaefe6d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:06.916350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaed8b3-992b-4901-80e7-2f55aaefe6d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:06.916624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaed8b3-992b-4901-80e7-2f55aaefe6d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:06.916892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaed8b3-992b-4901-80e7-2f55aaefe6d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:06.937567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaed8b3-992b-4901-80e7-2f55aaefe6d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:06.955182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaed8b3-992b-4901-80e7-2f55aaefe6d2 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:06.975721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4084d8e5cfd451894524d5003dcb6c8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:06.976799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4084d8e5cfd451894524d5003dcb6c8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:06.981698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 820/1653] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:10:07.030211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4084d8e5cfd451894524d5003dcb6c8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:07.034140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:07.056558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4084d8e5cfd451894524d5003dcb6c8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:07.057552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4084d8e5cfd451894524d5003dcb6c8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:07.116036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 834/1654] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:06 2022] DELETE /identity/v3/users/b4084d8e5cfd451894524d5003dcb6c8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:07.117381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cffb0-cb00-4a4a-b33e-c9a79de3482d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:07.117651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cffb0-cb00-4a4a-b33e-c9a79de3482d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:07.117924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cffb0-cb00-4a4a-b33e-c9a79de3482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:07.180949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4a1cffb0-cb00-4a4a-b33e-c9a79de3482d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:07.184733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4a1cffb0-cb00-4a4a-b33e-c9a79de3482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:07.369259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 821/1655] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:10:07.412642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:07.414237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:07.596756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecadd92-8a53-4232-8495-e2ac77623287 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:07.606070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccf9b7-c2c9-4fe6-bbfc-3be7f9306f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:07.607693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf9b7-c2c9-4fe6-bbfc-3be7f9306f87 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:07.608253 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf9b7-c2c9-4fe6-bbfc-3be7f9306f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:07.608737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccf9b7-c2c9-4fe6-bbfc-3be7f9306f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:07.630176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccf9b7-c2c9-4fe6-bbfc-3be7f9306f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:07.633094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccf9b7-c2c9-4fe6-bbfc-3be7f9306f87 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:07.654258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cffb0-cb00-4a4a-b33e-c9a79de3482d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:07.657434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4a1cffb0-cb00-4a4a-b33e-c9a79de3482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:07.660289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 835/1656] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:07.729550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cffb0-cb00-4a4a-b33e-c9a79de3482d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:07.757227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:07.758478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:07.759576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:07.760068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] PATH_INFO: `/v3/users/2058cf92a0c844f2bb81f9c50f13106d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:07.765910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2058cf92a0c844f2bb81f9c50f13106d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:07.767936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:07.869765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:07.938951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2058cf92a0c844f2bb81f9c50f13106d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:07.960935 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2058cf92a0c844f2bb81f9c50f13106d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:07.961964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2058cf92a0c844f2bb81f9c50f13106d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:07.977595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2058cf92a0c844f2bb81f9c50f13106d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:07.978523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2058cf92a0c844f2bb81f9c50f13106d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.018404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500321a-6ca7-4080-898e-c00df79a8954 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:08.018836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500321a-6ca7-4080-898e-c00df79a8954 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:08.019119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500321a-6ca7-4080-898e-c00df79a8954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:08.026255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 822/1657] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:07 2022] DELETE /identity/v3/users/2058cf92a0c844f2bb81f9c50f13106d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:08.036525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:08.040664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:08.072806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a500321a-6ca7-4080-898e-c00df79a8954 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:08.078814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a500321a-6ca7-4080-898e-c00df79a8954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:08.259431 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc7ef-3811-427c-a5c3-a0bb9cf63928 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:08.280199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 836/1658] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:08.284130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:08.284825 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:08.285127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:08.285406 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] PATH_INFO: `/v3/projects/a8655d26be3a4db9a1ebccd57169b537` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:08.290116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8655d26be3a4db9a1ebccd57169b537)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:08.291182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: WARNING py.warnings [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 17:10:08.291182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: warnings.warn(msg) Sep 19 17:10:08.291182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: Sep 19 17:10:08.292389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:08.311449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500321a-6ca7-4080-898e-c00df79a8954 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:08.312929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a500321a-6ca7-4080-898e-c00df79a8954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:08.440499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500321a-6ca7-4080-898e-c00df79a8954 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:08.475046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8655d26be3a4db9a1ebccd57169b537', 'request_id': 'req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.488040 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8655d26be3a4db9a1ebccd57169b537', 'request_id': 'req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.512956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8655d26be3a4db9a1ebccd57169b537', 'request_id': 'req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.548432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:08.563793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] The token cache is being invalidate because project a8655d26be3a4db9a1ebccd57169b537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:08.564105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.565341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.567548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 823/1659] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:08 2022] DELETE /identity/v3/projects/a8655d26be3a4db9a1ebccd57169b537 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:08.568389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bc12d-532a-4e48-98b4-1ba77f75b8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:08.569235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bc12d-532a-4e48-98b4-1ba77f75b8ad service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:08.569674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bc12d-532a-4e48-98b4-1ba77f75b8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:08.570116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bc12d-532a-4e48-98b4-1ba77f75b8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:08.571270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:08.573620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:08.576407 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9c3bc12d-532a-4e48-98b4-1ba77f75b8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:08.676105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:08.723528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bc12d-532a-4e48-98b4-1ba77f75b8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:08.725077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bc12d-532a-4e48-98b4-1ba77f75b8ad service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:08.742067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8a882-309c-409d-ac3e-fd8edd21d0dc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:08.751750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 837/1660] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:10:08.752653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bc12d-532a-4e48-98b4-1ba77f75b8ad service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:08.759382 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9c3bc12d-532a-4e48-98b4-1ba77f75b8ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:08.770072 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:08.771037 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:08.771854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:08.772399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] PATH_INFO: `/v3/users/a5aecb3232f54efe84dab40e40baf9d2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:08.776586 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5aecb3232f54efe84dab40e40baf9d2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:08.778997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:08.789067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bc12d-532a-4e48-98b4-1ba77f75b8ad service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:08.795593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:08.796373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:08.796751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:08.797152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] PATH_INFO: `/v3/users/7478d0a5e2cd41fe9a83573c426d3091` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:08.798462 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7478d0a5e2cd41fe9a83573c426d3091)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:08.806583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:08.915023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5aecb3232f54efe84dab40e40baf9d2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.930885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5aecb3232f54efe84dab40e40baf9d2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.931201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5aecb3232f54efe84dab40e40baf9d2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.946582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5aecb3232f54efe84dab40e40baf9d2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.947415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4ed43e6e-7ec8-4b1b-95a5-7a76e35c5e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5aecb3232f54efe84dab40e40baf9d2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.951330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7478d0a5e2cd41fe9a83573c426d3091'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:08.954956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7478d0a5e2cd41fe9a83573c426d3091'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:09.015318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7478d0a5e2cd41fe9a83573c426d3091'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:09.042798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7478d0a5e2cd41fe9a83573c426d3091'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:09.043601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7478d0a5e2cd41fe9a83573c426d3091'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:09.062285 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 824/1661] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:08 2022] DELETE /identity/v3/users/a5aecb3232f54efe84dab40e40baf9d2 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:09.076365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 838/1662] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:08 2022] DELETE /identity/v3/users/7478d0a5e2cd41fe9a83573c426d3091 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:09.080922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb19dce-d1b7-4eba-bdb0-e9de8f17c353 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:09.081241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb19dce-d1b7-4eba-bdb0-e9de8f17c353 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:09.081517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb19dce-d1b7-4eba-bdb0-e9de8f17c353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:09.117135 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7eb19dce-d1b7-4eba-bdb0-e9de8f17c353 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:09.125615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7eb19dce-d1b7-4eba-bdb0-e9de8f17c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:09.199225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:09.201067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:09.330189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 825/1663] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:09.373740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb19dce-d1b7-4eba-bdb0-e9de8f17c353 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:09.375581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7eb19dce-d1b7-4eba-bdb0-e9de8f17c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:09.416987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951a395-cba4-4559-b0c9-b0a8d54d3568 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:09.455993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:09.458769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:09.477083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:09.478307 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] PATH_INFO: `/v3/projects/8dc5eb16d7ed497e8a83cf8f297c1d65` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:09.484351 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc5eb16d7ed497e8a83cf8f297c1d65)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:09.487677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:09.505095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:09.551102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb19dce-d1b7-4eba-bdb0-e9de8f17c353 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:09.565973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5f3ae-e27d-41c4-ae8f-beca8b3830fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:09.566614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5f3ae-e27d-41c4-ae8f-beca8b3830fc service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:09.566892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5f3ae-e27d-41c4-ae8f-beca8b3830fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:09.567212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5f3ae-e27d-41c4-ae8f-beca8b3830fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:09.632879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5f3ae-e27d-41c4-ae8f-beca8b3830fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:09.635612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5f3ae-e27d-41c4-ae8f-beca8b3830fc service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:09.659683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:09.692768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 826/1664] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:09.699315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc5eb16d7ed497e8a83cf8f297c1d65', 'request_id': 'req-55a23a91-cbb7-4ecb-9ea0-fd369811c361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:09.755764 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc5eb16d7ed497e8a83cf8f297c1d65', 'request_id': 'req-55a23a91-cbb7-4ecb-9ea0-fd369811c361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:09.808748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc5eb16d7ed497e8a83cf8f297c1d65', 'request_id': 'req-55a23a91-cbb7-4ecb-9ea0-fd369811c361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:09.861919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] The token cache is being invalidate because project 8dc5eb16d7ed497e8a83cf8f297c1d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:09.863582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:09.867417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:09.883781 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 839/1665] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:09 2022] DELETE /identity/v3/projects/8dc5eb16d7ed497e8a83cf8f297c1d65 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:09.886139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5f3ae-e27d-41c4-ae8f-beca8b3830fc service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:09.903144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5f3ae-e27d-41c4-ae8f-beca8b3830fc service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:10.100439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:10.101263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:10.101548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:10.104645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] PATH_INFO: `/v3/users/05c3fcdca030450a89aa6aa8af411417` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:10.110463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c3fcdca030450a89aa6aa8af411417)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:10.120172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:10.283933 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c3fcdca030450a89aa6aa8af411417'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.299542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:10.301835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:10.330987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a23a91-cbb7-4ecb-9ea0-fd369811c361 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:10.332517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c3fcdca030450a89aa6aa8af411417'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.333909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c3fcdca030450a89aa6aa8af411417'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.350937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:10.351638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:10.351901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:10.352184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] PATH_INFO: `/v3/projects/cb5b1cefb5bc4270a0e2cbfc1d5fe12a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:10.360940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c3fcdca030450a89aa6aa8af411417'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.362196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5b1cefb5bc4270a0e2cbfc1d5fe12a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:10.364468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c3fcdca030450a89aa6aa8af411417'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.366606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:10.448617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 827/1666] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:09 2022] DELETE /identity/v3/users/05c3fcdca030450a89aa6aa8af411417 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:10.520085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5b1cefb5bc4270a0e2cbfc1d5fe12a', 'request_id': 'req-5eaa2638-5b3f-4856-b98c-43300b1acade'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.536956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5b1cefb5bc4270a0e2cbfc1d5fe12a', 'request_id': 'req-5eaa2638-5b3f-4856-b98c-43300b1acade'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.552393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5b1cefb5bc4270a0e2cbfc1d5fe12a', 'request_id': 'req-5eaa2638-5b3f-4856-b98c-43300b1acade'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.580023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] The token cache is being invalidate because project cb5b1cefb5bc4270a0e2cbfc1d5fe12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:10.580471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.581179 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.583085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 840/1667] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:10 2022] DELETE /identity/v3/projects/cb5b1cefb5bc4270a0e2cbfc1d5fe12a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:10.587039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:10.588723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:10.722776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015d4dc-91ab-4f8f-b095-e90a3b90669c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:10.763639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:10.872405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:10.873191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:10.874469 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:10.875989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] PATH_INFO: `/v3/users/5e35f9ce832843ecb042d86f7650f55a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:10.880138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e35f9ce832843ecb042d86f7650f55a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:10.883961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:10.975202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e35f9ce832843ecb042d86f7650f55a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.986258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e35f9ce832843ecb042d86f7650f55a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:10.987320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e35f9ce832843ecb042d86f7650f55a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:11.001623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e35f9ce832843ecb042d86f7650f55a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:11.004880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e35f9ce832843ecb042d86f7650f55a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:11.029840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 828/1668] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:10 2022] DELETE /identity/v3/users/5e35f9ce832843ecb042d86f7650f55a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:11.440622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:11.442235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:11.465717 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2638-5b3f-4856-b98c-43300b1acade admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:11.605814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:11.606872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:11.607378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:11.607863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] PATH_INFO: `/v3/projects/1c1cb3edbec24bcca72651b5214f8374` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:11.609331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1cb3edbec24bcca72651b5214f8374)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:11.611482 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:11.669813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:11.736359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1cb3edbec24bcca72651b5214f8374', 'request_id': 'req-bf4cec77-bd17-4d78-baa1-4235cf54da2b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:11.746112 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:11.747765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:11.775821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1cb3edbec24bcca72651b5214f8374', 'request_id': 'req-bf4cec77-bd17-4d78-baa1-4235cf54da2b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:11.789481 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439151da-f424-4503-959f-eea1a7c2dfd0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:11.808174 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1cb3edbec24bcca72651b5214f8374', 'request_id': 'req-bf4cec77-bd17-4d78-baa1-4235cf54da2b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:11.838944 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] The token cache is being invalidate because project 1c1cb3edbec24bcca72651b5214f8374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:11.839242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:11.841013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf4cec77-bd17-4d78-baa1-4235cf54da2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:11.848621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 841/1669] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:11 2022] DELETE /identity/v3/projects/1c1cb3edbec24bcca72651b5214f8374 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:11.852840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53431de-82fc-4d8a-9f9d-52065b4ebcb2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:11.853189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53431de-82fc-4d8a-9f9d-52065b4ebcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:11.853479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53431de-82fc-4d8a-9f9d-52065b4ebcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:11.895114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b53431de-82fc-4d8a-9f9d-52065b4ebcb2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:11.898645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b53431de-82fc-4d8a-9f9d-52065b4ebcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:11.967915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:11.968209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:11.968453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:11.968904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] PATH_INFO: `/v3/projects/72ecd197c6784d6ab0f377ad0d8811e3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:11.970817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ecd197c6784d6ab0f377ad0d8811e3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:11.972877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:12.044628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 842/1670] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:12.045283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53431de-82fc-4d8a-9f9d-52065b4ebcb2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:12.050028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b53431de-82fc-4d8a-9f9d-52065b4ebcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:12.052114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:12.055267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ecd197c6784d6ab0f377ad0d8811e3', 'request_id': 'req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:12.071900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ecd197c6784d6ab0f377ad0d8811e3', 'request_id': 'req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:12.085993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ecd197c6784d6ab0f377ad0d8811e3', 'request_id': 'req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:12.093180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53431de-82fc-4d8a-9f9d-52065b4ebcb2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:12.104773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] The token cache is being invalidate because project 72ecd197c6784d6ab0f377ad0d8811e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:12.105223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:12.105960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-db38cf81-a5a9-416b-9fd7-c2e2eebbc503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:12.109066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 829/1671] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:11 2022] DELETE /identity/v3/projects/72ecd197c6784d6ab0f377ad0d8811e3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:12.110937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba94b8-9cbe-47b2-bfd3-bfdfd400393a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.111454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba94b8-9cbe-47b2-bfd3-bfdfd400393a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.111948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba94b8-9cbe-47b2-bfd3-bfdfd400393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.146989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ddba94b8-9cbe-47b2-bfd3-bfdfd400393a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:12.155662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ddba94b8-9cbe-47b2-bfd3-bfdfd400393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:12.235851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:12.236786 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.237252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.237662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] PATH_INFO: `/v3/projects/cd0e3ec5903e460b8af76efcb0e3c15a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.242819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0e3ec5903e460b8af76efcb0e3c15a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:12.244872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:12.277847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 830/1672] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:12.279621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a83f09-5547-48e7-b838-c04294a4a67b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.280016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a83f09-5547-48e7-b838-c04294a4a67b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.280399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a83f09-5547-48e7-b838-c04294a4a67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.304997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-12a83f09-5547-48e7-b838-c04294a4a67b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:12.306214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-12a83f09-5547-48e7-b838-c04294a4a67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:12.320272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 831/1673] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:12.321519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a83f09-5547-48e7-b838-c04294a4a67b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:12.336856 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a83f09-5547-48e7-b838-c04294a4a67b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:12.354748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0e3ec5903e460b8af76efcb0e3c15a', 'request_id': 'req-8282d7b2-990d-4916-8a98-ec638e41aa95'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:12.364427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:12.368727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0e3ec5903e460b8af76efcb0e3c15a', 'request_id': 'req-8282d7b2-990d-4916-8a98-ec638e41aa95'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:12.387905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0e3ec5903e460b8af76efcb0e3c15a', 'request_id': 'req-8282d7b2-990d-4916-8a98-ec638e41aa95'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:12.410050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] The token cache is being invalidate because project cd0e3ec5903e460b8af76efcb0e3c15a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:12.410469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:12.424303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8282d7b2-990d-4916-8a98-ec638e41aa95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:12.430082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 843/1674] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:12 2022] DELETE /identity/v3/projects/cd0e3ec5903e460b8af76efcb0e3c15a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:12.434512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84a27e-4edc-4fa6-a5fb-e317d491f26b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.434931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84a27e-4edc-4fa6-a5fb-e317d491f26b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.435315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84a27e-4edc-4fa6-a5fb-e317d491f26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.459878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af4a1b-8736-43ba-8202-cca71a98d9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:12.461784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af4a1b-8736-43ba-8202-cca71a98d9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.462170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af4a1b-8736-43ba-8202-cca71a98d9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.462456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af4a1b-8736-43ba-8202-cca71a98d9a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.463144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af4a1b-8736-43ba-8202-cca71a98d9a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:12.463452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af4a1b-8736-43ba-8202-cca71a98d9a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:12.468696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af4a1b-8736-43ba-8202-cca71a98d9a7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:12.486867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fd84a27e-4edc-4fa6-a5fb-e317d491f26b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:12.490974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fd84a27e-4edc-4fa6-a5fb-e317d491f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:12.509164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 832/1675] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:12.513526 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bbbec-7022-4911-9c98-8b7f008465af None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.513858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bbbec-7022-4911-9c98-8b7f008465af None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.514158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bbbec-7022-4911-9c98-8b7f008465af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.516263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 844/1676] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:12.517476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84a27e-4edc-4fa6-a5fb-e317d491f26b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:12.519591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fd84a27e-4edc-4fa6-a5fb-e317d491f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:12.553337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84a27e-4edc-4fa6-a5fb-e317d491f26b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:12.560716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8407151-0468-4a58-92b5-b139706c9392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:12.561616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8407151-0468-4a58-92b5-b139706c9392 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.562099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8407151-0468-4a58-92b5-b139706c9392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.562590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8407151-0468-4a58-92b5-b139706c9392 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.563457 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8407151-0468-4a58-92b5-b139706c9392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:12.566656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8407151-0468-4a58-92b5-b139706c9392 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:12.576568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-052bbbec-7022-4911-9c98-8b7f008465af None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:12.581641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-052bbbec-7022-4911-9c98-8b7f008465af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:12.625144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 845/1677] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:12 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:12.628648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8407151-0468-4a58-92b5-b139706c9392 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:12.637208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 833/1678] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:12.642225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bbbec-7022-4911-9c98-8b7f008465af None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:12.692492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bbbec-7022-4911-9c98-8b7f008465af None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:12.799534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8407151-0468-4a58-92b5-b139706c9392 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:12.815041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548135b-21f8-40c2-8cbd-927c0b6c5f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:12.815041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548135b-21f8-40c2-8cbd-927c0b6c5f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.815418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548135b-21f8-40c2-8cbd-927c0b6c5f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.815527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548135b-21f8-40c2-8cbd-927c0b6c5f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.816199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548135b-21f8-40c2-8cbd-927c0b6c5f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:12.816502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548135b-21f8-40c2-8cbd-927c0b6c5f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:12.818292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548135b-21f8-40c2-8cbd-927c0b6c5f07 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:12.851180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 846/1679] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:12.851180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee689b-233a-47bb-9d57-6c4597a96ca3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.851180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee689b-233a-47bb-9d57-6c4597a96ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.851180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee689b-233a-47bb-9d57-6c4597a96ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.878132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:12.888888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1ea33-b49e-4463-854a-79c5435c7163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:12.891870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ea33-b49e-4463-854a-79c5435c7163 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.892255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ea33-b49e-4463-854a-79c5435c7163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.892544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1ea33-b49e-4463-854a-79c5435c7163 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.893816 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1ea33-b49e-4463-854a-79c5435c7163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:12.896946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1ea33-b49e-4463-854a-79c5435c7163 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:12.902552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4eee689b-233a-47bb-9d57-6c4597a96ca3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:12.903834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4eee689b-233a-47bb-9d57-6c4597a96ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:12.918583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 847/1680] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:12.922339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee689b-233a-47bb-9d57-6c4597a96ca3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:12.927479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4eee689b-233a-47bb-9d57-6c4597a96ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:12.959254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee689b-233a-47bb-9d57-6c4597a96ca3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:12.966919 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 834/1681] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:12 2022] POST /identity/v3/users => generated 283 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:12.967962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1ea33-b49e-4463-854a-79c5435c7163 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:12.977383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:12.978864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:12.979339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:12.979802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] PATH_INFO: `/v3/projects/b2ba8a4f85bf4d7181554cf0c25023e4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:12.981215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ba8a4f85bf4d7181554cf0c25023e4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:12.983414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:12.983906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1ea33-b49e-4463-854a-79c5435c7163 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:13.009084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f43b8-98cc-4517-b628-1644669f34bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:13.009841 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f43b8-98cc-4517-b628-1644669f34bf admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.010062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f43b8-98cc-4517-b628-1644669f34bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.010342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f43b8-98cc-4517-b628-1644669f34bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.011348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f43b8-98cc-4517-b628-1644669f34bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:13.014806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f43b8-98cc-4517-b628-1644669f34bf admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:13.081385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 835/1682] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:12 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:13.081385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f43b8-98cc-4517-b628-1644669f34bf admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:13.126510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ba8a4f85bf4d7181554cf0c25023e4', 'request_id': 'req-856f5cc3-de6a-49fc-9502-9271e220d6bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:13.142816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ba8a4f85bf4d7181554cf0c25023e4', 'request_id': 'req-856f5cc3-de6a-49fc-9502-9271e220d6bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:13.164499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ba8a4f85bf4d7181554cf0c25023e4', 'request_id': 'req-856f5cc3-de6a-49fc-9502-9271e220d6bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:13.187199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] The token cache is being invalidate because project b2ba8a4f85bf4d7181554cf0c25023e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:13.187895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:13.189364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:13.193083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 848/1683] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:12 2022] DELETE /identity/v3/projects/b2ba8a4f85bf4d7181554cf0c25023e4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:13.194304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:13.202223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:13.219962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f43b8-98cc-4517-b628-1644669f34bf admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:13.278931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:13.325659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaa7eb-ddf3-41de-8153-6c61c8eee57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:13.326289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaa7eb-ddf3-41de-8153-6c61c8eee57e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.326567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaa7eb-ddf3-41de-8153-6c61c8eee57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.326838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaa7eb-ddf3-41de-8153-6c61c8eee57e admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.327506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaa7eb-ddf3-41de-8153-6c61c8eee57e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:13.327805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaa7eb-ddf3-41de-8153-6c61c8eee57e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:13.329578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaa7eb-ddf3-41de-8153-6c61c8eee57e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:13.350643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 836/1684] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:13.351644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaa7eb-ddf3-41de-8153-6c61c8eee57e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:13.354830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5ddaa7eb-ddf3-41de-8153-6c61c8eee57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:13.369024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaa7eb-ddf3-41de-8153-6c61c8eee57e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:13.377884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a2638-8cd9-41f0-b92c-9bc7bf42fa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:13.378822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a2638-8cd9-41f0-b92c-9bc7bf42fa9c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.379222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a2638-8cd9-41f0-b92c-9bc7bf42fa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.379629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a2638-8cd9-41f0-b92c-9bc7bf42fa9c admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.380636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a2638-8cd9-41f0-b92c-9bc7bf42fa9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:13.384151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a2638-8cd9-41f0-b92c-9bc7bf42fa9c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:13.384410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f5cc3-de6a-49fc-9502-9271e220d6bd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:13.396921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cea30c-2e61-4761-a826-913354075b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:13.401594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cea30c-2e61-4761-a826-913354075b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.402051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cea30c-2e61-4761-a826-913354075b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.402490 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cea30c-2e61-4761-a826-913354075b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.403368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cea30c-2e61-4761-a826-913354075b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:13.405259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cea30c-2e61-4761-a826-913354075b12 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:13.420707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 849/1685] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:13.422643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0d471-fdfe-4b5d-baa1-137cb0c14bb5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.423062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0d471-fdfe-4b5d-baa1-137cb0c14bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.423441 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0d471-fdfe-4b5d-baa1-137cb0c14bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.429804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 837/1686] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:13 2022] POST /identity/v3/users => generated 283 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:13.434925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ffc88-2bcd-4888-aeac-4abf6a5660a1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.435276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ffc88-2bcd-4888-aeac-4abf6a5660a1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.436760 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ffc88-2bcd-4888-aeac-4abf6a5660a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.452976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d2d0d471-fdfe-4b5d-baa1-137cb0c14bb5 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:13.454283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d2d0d471-fdfe-4b5d-baa1-137cb0c14bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:13.478027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 850/1687] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:13.486956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0d471-fdfe-4b5d-baa1-137cb0c14bb5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:13.492942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d2d0d471-fdfe-4b5d-baa1-137cb0c14bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:13.509916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b37ffc88-2bcd-4888-aeac-4abf6a5660a1 None None] MFA Rules not processed for user `2b29780489334bb6807674a8c4ea5239`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:13.511178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b37ffc88-2bcd-4888-aeac-4abf6a5660a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:13.512316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0d471-fdfe-4b5d-baa1-137cb0c14bb5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:13.530700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ad7f-c207-4fc3-8b8c-21c3254ef90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:13.532263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ad7f-c207-4fc3-8b8c-21c3254ef90f admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.534232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ad7f-c207-4fc3-8b8c-21c3254ef90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.534742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422ad7f-c207-4fc3-8b8c-21c3254ef90f admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.535601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ad7f-c207-4fc3-8b8c-21c3254ef90f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:13.541138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422ad7f-c207-4fc3-8b8c-21c3254ef90f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:13.609305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 851/1688] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:13 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:13.610562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ad7f-c207-4fc3-8b8c-21c3254ef90f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:13.619951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:13.725425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 838/1689] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:13.725425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ffc88-2bcd-4888-aeac-4abf6a5660a1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:13.732095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ffc88-2bcd-4888-aeac-4abf6a5660a1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:13.784691 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422ad7f-c207-4fc3-8b8c-21c3254ef90f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:13.791494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170caae-5a4d-4be7-8079-311d3a83f6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:13.792457 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170caae-5a4d-4be7-8079-311d3a83f6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.792951 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170caae-5a4d-4be7-8079-311d3a83f6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.793447 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170caae-5a4d-4be7-8079-311d3a83f6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.794339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170caae-5a4d-4be7-8079-311d3a83f6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:13.796169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170caae-5a4d-4be7-8079-311d3a83f6fb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:13.811898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 852/1690] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:13.813593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0f23c-5a6c-43ab-98d5-6e9df303e17e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.814229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0f23c-5a6c-43ab-98d5-6e9df303e17e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.814776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0f23c-5a6c-43ab-98d5-6e9df303e17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.846563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f1b0f23c-5a6c-43ab-98d5-6e9df303e17e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:13.847987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a94e03-0e6c-4bca-be96-a94035873d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:13.848672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f1b0f23c-5a6c-43ab-98d5-6e9df303e17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:13.854957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a94e03-0e6c-4bca-be96-a94035873d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.855301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a94e03-0e6c-4bca-be96-a94035873d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.857782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a94e03-0e6c-4bca-be96-a94035873d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.866139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a94e03-0e6c-4bca-be96-a94035873d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:13.867309 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a94e03-0e6c-4bca-be96-a94035873d93 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:13.880068 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 853/1691] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:13.882031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0f23c-5a6c-43ab-98d5-6e9df303e17e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:13.889680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 839/1692] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:13.889680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662e4b0-a734-44f0-9dff-b9ed98293d6f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.889680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662e4b0-a734-44f0-9dff-b9ed98293d6f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.889680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662e4b0-a734-44f0-9dff-b9ed98293d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.900307 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0f23c-5a6c-43ab-98d5-6e9df303e17e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:13.911662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce78d7-96d2-424e-80d0-1b29c23c5106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:13.912930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce78d7-96d2-424e-80d0-1b29c23c5106 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:13.913600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce78d7-96d2-424e-80d0-1b29c23c5106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:13.914146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce78d7-96d2-424e-80d0-1b29c23c5106 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:13.914987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce78d7-96d2-424e-80d0-1b29c23c5106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:13.923603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce78d7-96d2-424e-80d0-1b29c23c5106 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:13.943444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e662e4b0-a734-44f0-9dff-b9ed98293d6f None None] MFA Rules not processed for user `2b29780489334bb6807674a8c4ea5239`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:13.945967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e662e4b0-a734-44f0-9dff-b9ed98293d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:13.992989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 854/1693] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:13 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:13.995085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce78d7-96d2-424e-80d0-1b29c23c5106 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.009543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce78d7-96d2-424e-80d0-1b29c23c5106 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:14.015894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbf26-28e2-4a3c-9d47-46b8b6290c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:14.017389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbf26-28e2-4a3c-9d47-46b8b6290c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:14.017789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbf26-28e2-4a3c-9d47-46b8b6290c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:14.018193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cbf26-28e2-4a3c-9d47-46b8b6290c51 admin admin] PATH_INFO: `/v3/projects/1e582f69e848445e803110627c3c8616/users/9c5011e4eaed42889884b7a5365b599a/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:14.039572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cbf26-28e2-4a3c-9d47-46b8b6290c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e582f69e848445e803110627c3c8616, user_id=9c5011e4eaed42889884b7a5365b599a, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:14.042563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914cbf26-28e2-4a3c-9d47-46b8b6290c51 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:14.061835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 855/1694] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:13 2022] PUT /identity/v3/projects/1e582f69e848445e803110627c3c8616/users/9c5011e4eaed42889884b7a5365b599a/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:14.062962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbf26-28e2-4a3c-9d47-46b8b6290c51 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.090339 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 840/1695] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:14.091603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662e4b0-a734-44f0-9dff-b9ed98293d6f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.126616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:14.131313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662e4b0-a734-44f0-9dff-b9ed98293d6f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:14.165866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cbf26-28e2-4a3c-9d47-46b8b6290c51 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:14.173223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dd58f-bad9-48b5-9bec-ec8c540dfd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:14.174001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dd58f-bad9-48b5-9bec-ec8c540dfd9c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:14.174479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dd58f-bad9-48b5-9bec-ec8c540dfd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:14.174663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dd58f-bad9-48b5-9bec-ec8c540dfd9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:14.175828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dd58f-bad9-48b5-9bec-ec8c540dfd9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:14.176142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dd58f-bad9-48b5-9bec-ec8c540dfd9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:14.178246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dd58f-bad9-48b5-9bec-ec8c540dfd9c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:14.196824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 856/1696] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:14.197897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dd58f-bad9-48b5-9bec-ec8c540dfd9c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.210789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dd58f-bad9-48b5-9bec-ec8c540dfd9c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:14.217782 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83262045-7e80-4d08-9554-694cfaa56905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:14.218605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83262045-7e80-4d08-9554-694cfaa56905 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:14.218859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83262045-7e80-4d08-9554-694cfaa56905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:14.219147 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83262045-7e80-4d08-9554-694cfaa56905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:14.219910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83262045-7e80-4d08-9554-694cfaa56905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:14.222541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83262045-7e80-4d08-9554-694cfaa56905 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:14.236608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 857/1697] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:14.237890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4e5f-16bd-490b-8bd2-1ad1571c5b47 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:14.238276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4e5f-16bd-490b-8bd2-1ad1571c5b47 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:14.238601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4e5f-16bd-490b-8bd2-1ad1571c5b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:14.273051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bc295-4335-4632-aedc-c7f1a0c9159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:14.273841 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bc295-4335-4632-aedc-c7f1a0c9159c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:14.274189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bc295-4335-4632-aedc-c7f1a0c9159c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:14.274550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bc295-4335-4632-aedc-c7f1a0c9159c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:14.275948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025bc295-4335-4632-aedc-c7f1a0c9159c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:14.277702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025bc295-4335-4632-aedc-c7f1a0c9159c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:14.278776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0aad4e5f-16bd-490b-8bd2-1ad1571c5b47 None None] MFA Rules not processed for user `9c5011e4eaed42889884b7a5365b599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:14.280161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0aad4e5f-16bd-490b-8bd2-1ad1571c5b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:14.294459 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 841/1698] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:14.297934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bc295-4335-4632-aedc-c7f1a0c9159c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.299048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-025bc295-4335-4632-aedc-c7f1a0c9159c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:14.340011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:14.399448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 858/1699] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:14.400169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad4e5f-16bd-490b-8bd2-1ad1571c5b47 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.426548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad4e5f-16bd-490b-8bd2-1ad1571c5b47 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:14.437888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d872-c2a8-4e50-8ee0-75c78366af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:14.438535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d872-c2a8-4e50-8ee0-75c78366af0d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:14.438832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d872-c2a8-4e50-8ee0-75c78366af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:14.439537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d872-c2a8-4e50-8ee0-75c78366af0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:14.441713 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16d872-c2a8-4e50-8ee0-75c78366af0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:14.450699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16d872-c2a8-4e50-8ee0-75c78366af0d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:14.462702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025bc295-4335-4632-aedc-c7f1a0c9159c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:14.472158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25138ea3-1359-4d58-9af9-b2ff6a2ae59b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:14.474159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25138ea3-1359-4d58-9af9-b2ff6a2ae59b service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:14.474930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25138ea3-1359-4d58-9af9-b2ff6a2ae59b service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:14.475370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25138ea3-1359-4d58-9af9-b2ff6a2ae59b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:14.505002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 859/1700] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:14 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:14.507159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d872-c2a8-4e50-8ee0-75c78366af0d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.590046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25138ea3-1359-4d58-9af9-b2ff6a2ae59b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:14.594867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25138ea3-1359-4d58-9af9-b2ff6a2ae59b service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:14.611377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 842/1701] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:14.612563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25138ea3-1359-4d58-9af9-b2ff6a2ae59b service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.628426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25138ea3-1359-4d58-9af9-b2ff6a2ae59b service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:14.674448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d872-c2a8-4e50-8ee0-75c78366af0d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:14.688039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ba065-4a35-4dbb-907b-e388f3e6f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:14.691288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ba065-4a35-4dbb-907b-e388f3e6f1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:14.691771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ba065-4a35-4dbb-907b-e388f3e6f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:14.692565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ba065-4a35-4dbb-907b-e388f3e6f1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:14.695114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ba065-4a35-4dbb-907b-e388f3e6f1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:14.701550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ba065-4a35-4dbb-907b-e388f3e6f1e1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:14.731421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 860/1702] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:14.732603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ba065-4a35-4dbb-907b-e388f3e6f1e1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.760234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ba065-4a35-4dbb-907b-e388f3e6f1e1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:14.781124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b39b-891b-41d8-8481-b937421ef0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:14.781869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b39b-891b-41d8-8481-b937421ef0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:14.782155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b39b-891b-41d8-8481-b937421ef0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:14.790484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b39b-891b-41d8-8481-b937421ef0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:14.791240 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465b39b-891b-41d8-8481-b937421ef0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:14.804874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f0c5-8077-4a00-81be-669088eb10a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:14.805947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465b39b-891b-41d8-8481-b937421ef0ce admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:14.807953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f0c5-8077-4a00-81be-669088eb10a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:14.808239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f0c5-8077-4a00-81be-669088eb10a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:14.808553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72f0c5-8077-4a00-81be-669088eb10a3 admin admin] PATH_INFO: `/v3/projects/fd266d6bb3f2400fb2f3b07ae85f9e14/users/471fe932ad8f4a2186da8f57d4237c9c/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:14.851156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72f0c5-8077-4a00-81be-669088eb10a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd266d6bb3f2400fb2f3b07ae85f9e14, user_id=471fe932ad8f4a2186da8f57d4237c9c, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:14.856462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72f0c5-8077-4a00-81be-669088eb10a3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:14.885938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 861/1703] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:14 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:14.888779 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b39b-891b-41d8-8481-b937421ef0ce admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.900752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 843/1704] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:14 2022] PUT /identity/v3/projects/fd266d6bb3f2400fb2f3b07ae85f9e14/users/471fe932ad8f4a2186da8f57d4237c9c/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:14.905819 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f0c5-8077-4a00-81be-669088eb10a3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:14.911918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:15.064385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:15.107855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b39b-891b-41d8-8481-b937421ef0ce admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:15.115256 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72f0c5-8077-4a00-81be-669088eb10a3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:15.121402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27641cbe-3ac2-430a-aed0-6caf96146411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:15.122243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27641cbe-3ac2-430a-aed0-6caf96146411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.122596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27641cbe-3ac2-430a-aed0-6caf96146411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.122944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27641cbe-3ac2-430a-aed0-6caf96146411 admin admin] PATH_INFO: `/v3/projects/18f4e92be6674e9bafe7ff815253dce7/users/7ec24d5d0eb041e79b9d9ffa7be8c3ff/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.130452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5577e-f0c5-4d1d-bc2c-2cc7f55d04a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:15.131096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5577e-f0c5-4d1d-bc2c-2cc7f55d04a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.132378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5577e-f0c5-4d1d-bc2c-2cc7f55d04a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.132665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5577e-f0c5-4d1d-bc2c-2cc7f55d04a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.133667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5577e-f0c5-4d1d-bc2c-2cc7f55d04a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:15.135638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5577e-f0c5-4d1d-bc2c-2cc7f55d04a4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:15.154241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27641cbe-3ac2-430a-aed0-6caf96146411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f4e92be6674e9bafe7ff815253dce7, user_id=7ec24d5d0eb041e79b9d9ffa7be8c3ff, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:15.157839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27641cbe-3ac2-430a-aed0-6caf96146411 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:15.184311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 844/1705] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:14 2022] PUT /identity/v3/projects/18f4e92be6674e9bafe7ff815253dce7/users/7ec24d5d0eb041e79b9d9ffa7be8c3ff/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:15.185460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27641cbe-3ac2-430a-aed0-6caf96146411 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:15.207038 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 862/1706] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:14 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:15.216075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4da568-43a7-41b9-931e-bcbf5668d0c4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.223828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4da568-43a7-41b9-931e-bcbf5668d0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.224578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4da568-43a7-41b9-931e-bcbf5668d0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.295845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27641cbe-3ac2-430a-aed0-6caf96146411 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:15.301407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3673-6e76-4368-b5aa-43972095ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:15.302107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3673-6e76-4368-b5aa-43972095ce05 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.302826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3673-6e76-4368-b5aa-43972095ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.302826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3673-6e76-4368-b5aa-43972095ce05 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.303258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa3673-6e76-4368-b5aa-43972095ce05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:15.305268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa3673-6e76-4368-b5aa-43972095ce05 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:15.331204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-aa4da568-43a7-41b9-931e-bcbf5668d0c4 None None] MFA Rules not processed for user `471fe932ad8f4a2186da8f57d4237c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:15.332280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aa4da568-43a7-41b9-931e-bcbf5668d0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:15.337937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 845/1707] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:15 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:15.337937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddd805-c66e-4b75-8104-f44ef41ac2a3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.337937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddd805-c66e-4b75-8104-f44ef41ac2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.337937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddd805-c66e-4b75-8104-f44ef41ac2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.364188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b2ddd805-c66e-4b75-8104-f44ef41ac2a3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:15.365793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b2ddd805-c66e-4b75-8104-f44ef41ac2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:15.378088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 846/1708] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:15.384893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddd805-c66e-4b75-8104-f44ef41ac2a3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:15.399566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddd805-c66e-4b75-8104-f44ef41ac2a3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:15.406727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91989fd-5522-4db2-af27-62d331436a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:15.407420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91989fd-5522-4db2-af27-62d331436a88 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.407813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91989fd-5522-4db2-af27-62d331436a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.408097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91989fd-5522-4db2-af27-62d331436a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.408939 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91989fd-5522-4db2-af27-62d331436a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:15.411041 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91989fd-5522-4db2-af27-62d331436a88 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:15.427386 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 847/1709] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:15.428345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91989fd-5522-4db2-af27-62d331436a88 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:15.442506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91989fd-5522-4db2-af27-62d331436a88 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:15.449846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54fe6f-5693-4ba9-8c04-54a6fc87971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:15.451150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54fe6f-5693-4ba9-8c04-54a6fc87971c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.451150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54fe6f-5693-4ba9-8c04-54a6fc87971c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.451417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54fe6f-5693-4ba9-8c04-54a6fc87971c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.452210 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54fe6f-5693-4ba9-8c04-54a6fc87971c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:15.454378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54fe6f-5693-4ba9-8c04-54a6fc87971c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:15.476366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 848/1710] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:15.477723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54fe6f-5693-4ba9-8c04-54a6fc87971c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:15.509982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54fe6f-5693-4ba9-8c04-54a6fc87971c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:15.516812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c4ddf-2e82-41b3-b170-e27eddbf9eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:15.517937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c4ddf-2e82-41b3-b170-e27eddbf9eee admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.518821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c4ddf-2e82-41b3-b170-e27eddbf9eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.520957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c4ddf-2e82-41b3-b170-e27eddbf9eee admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.522160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c4ddf-2e82-41b3-b170-e27eddbf9eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:15.526932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c4ddf-2e82-41b3-b170-e27eddbf9eee admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:15.555147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 849/1711] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:15.556452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c4ddf-2e82-41b3-b170-e27eddbf9eee admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:15.560846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5a4c4ddf-2e82-41b3-b170-e27eddbf9eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:15.591243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 863/1712] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:15.592102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4da568-43a7-41b9-931e-bcbf5668d0c4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:15.613188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4da568-43a7-41b9-931e-bcbf5668d0c4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:15.630882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff17a7-c99c-459c-b147-bc494fd6aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:15.632010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff17a7-c99c-459c-b147-bc494fd6aeee admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.632290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff17a7-c99c-459c-b147-bc494fd6aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.632562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff17a7-c99c-459c-b147-bc494fd6aeee admin admin] PATH_INFO: `/v3/projects/d60a55aee02a4866b8312e456f69fc65/users/fc0f7339f3d940538891555187fe34ac/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.676745 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff17a7-c99c-459c-b147-bc494fd6aeee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60a55aee02a4866b8312e456f69fc65, user_id=fc0f7339f3d940538891555187fe34ac, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:15.679858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff17a7-c99c-459c-b147-bc494fd6aeee admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:15.707962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c4ddf-2e82-41b3-b170-e27eddbf9eee admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:15.708516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 864/1713] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:15 2022] PUT /identity/v3/projects/d60a55aee02a4866b8312e456f69fc65/users/fc0f7339f3d940538891555187fe34ac/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:15.709412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff17a7-c99c-459c-b147-bc494fd6aeee admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:15.750868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:15.825191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc304750-fabb-4ae1-918f-b9acc14c6517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:15.825191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc304750-fabb-4ae1-918f-b9acc14c6517 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.825191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc304750-fabb-4ae1-918f-b9acc14c6517 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.825191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc304750-fabb-4ae1-918f-b9acc14c6517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.846609 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:15.854702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff17a7-c99c-459c-b147-bc494fd6aeee admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:15.872177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4367203-9541-4305-a7a7-c190da17d5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:15.872883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4367203-9541-4305-a7a7-c190da17d5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:15.873255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4367203-9541-4305-a7a7-c190da17d5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:15.873471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4367203-9541-4305-a7a7-c190da17d5d6 admin admin] PATH_INFO: `/v3/projects/881718e5796444408d4024fbe83a4eb2/users/b09e69139f1746a586325fdc3262394c/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:15.915304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4367203-9541-4305-a7a7-c190da17d5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881718e5796444408d4024fbe83a4eb2, user_id=b09e69139f1746a586325fdc3262394c, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:15.930222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4367203-9541-4305-a7a7-c190da17d5d6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:15.959139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 865/1714] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:15 2022] PUT /identity/v3/projects/881718e5796444408d4024fbe83a4eb2/users/b09e69139f1746a586325fdc3262394c/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:15.960425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4367203-9541-4305-a7a7-c190da17d5d6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:15.962010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc304750-fabb-4ae1-918f-b9acc14c6517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:15.964237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc304750-fabb-4ae1-918f-b9acc14c6517 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:15.998270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 850/1715] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:16.001910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc304750-fabb-4ae1-918f-b9acc14c6517 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:16.030203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc304750-fabb-4ae1-918f-b9acc14c6517 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:16.081094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4367203-9541-4305-a7a7-c190da17d5d6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:16.087687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b2d9e-d8f7-4ecf-a5bb-a2c39a4af847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:16.088419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2d9e-d8f7-4ecf-a5bb-a2c39a4af847 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:16.088827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2d9e-d8f7-4ecf-a5bb-a2c39a4af847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:16.089189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b2d9e-d8f7-4ecf-a5bb-a2c39a4af847 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:16.089924 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b2d9e-d8f7-4ecf-a5bb-a2c39a4af847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:16.092097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b2d9e-d8f7-4ecf-a5bb-a2c39a4af847 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:16.134100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 866/1716] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:15 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:16.136186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed50f2-3dbb-4133-88c2-f97f76ff3e20 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:16.136469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed50f2-3dbb-4133-88c2-f97f76ff3e20 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:16.136801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed50f2-3dbb-4133-88c2-f97f76ff3e20 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:16.138715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 867/1717] 10.222.0.76 () {54 vars in 912 bytes} [Mon Sep 19 17:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:10:16.139971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a197-056c-4c76-9418-3f32c13968fc None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:16.140232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a197-056c-4c76-9418-3f32c13968fc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:16.140534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776a197-056c-4c76-9418-3f32c13968fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:16.222962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0776a197-056c-4c76-9418-3f32c13968fc None None] MFA Rules not processed for user `b09e69139f1746a586325fdc3262394c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:16.224693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0776a197-056c-4c76-9418-3f32c13968fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:16.292186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6433c2-f8b4-4a86-894d-fda2241a1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:16.292843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6433c2-f8b4-4a86-894d-fda2241a1a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:16.298131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6433c2-f8b4-4a86-894d-fda2241a1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:16.298548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6433c2-f8b4-4a86-894d-fda2241a1a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:16.301612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6433c2-f8b4-4a86-894d-fda2241a1a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:16.304323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6433c2-f8b4-4a86-894d-fda2241a1a15 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:16.357507 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 851/1718] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:16.358517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6433c2-f8b4-4a86-894d-fda2241a1a15 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:16.381244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6433c2-f8b4-4a86-894d-fda2241a1a15 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:16.407967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 868/1719] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:16.409771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa94d0-9e24-4f6f-950a-fce750997d29 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:16.410350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa94d0-9e24-4f6f-950a-fce750997d29 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:16.411075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa94d0-9e24-4f6f-950a-fce750997d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:16.486568 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-82aa94d0-9e24-4f6f-950a-fce750997d29 None None] MFA Rules not processed for user `da4a83dd0cb64e219bc16f8cf0b0af57`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:16.487962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-82aa94d0-9e24-4f6f-950a-fce750997d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:16.514969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5728f-1f5b-4de1-9df7-5dce24bff3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:16.515614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5728f-1f5b-4de1-9df7-5dce24bff3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:16.515893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5728f-1f5b-4de1-9df7-5dce24bff3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:16.516161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5728f-1f5b-4de1-9df7-5dce24bff3b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:16.516826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5728f-1f5b-4de1-9df7-5dce24bff3b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:16.518882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5728f-1f5b-4de1-9df7-5dce24bff3b7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:16.555927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:16.568524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 852/1720] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:16 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:16.570016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a93625-fd41-4639-9965-03b8ec7464df None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:16.570305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a93625-fd41-4639-9965-03b8ec7464df None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:16.570576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a93625-fd41-4639-9965-03b8ec7464df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:16.602059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:16.632220 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 869/1721] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:16.633418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa94d0-9e24-4f6f-950a-fce750997d29 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:16.637940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e9a93625-fd41-4639-9965-03b8ec7464df None None] MFA Rules not processed for user `58005342342744a98bbfe8ed97ad151b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:16.639714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e9a93625-fd41-4639-9965-03b8ec7464df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:16.646354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa94d0-9e24-4f6f-950a-fce750997d29 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:16.656887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32602d8a-fd45-41f4-a54f-83961008751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:16.657648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32602d8a-fd45-41f4-a54f-83961008751b admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:16.657926 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32602d8a-fd45-41f4-a54f-83961008751b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:16.658199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32602d8a-fd45-41f4-a54f-83961008751b admin admin] PATH_INFO: `/v3/projects/d60a55aee02a4866b8312e456f69fc65/users/fc0f7339f3d940538891555187fe34ac/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:16.661450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32602d8a-fd45-41f4-a54f-83961008751b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60a55aee02a4866b8312e456f69fc65, user_id=fc0f7339f3d940538891555187fe34ac, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:16.665077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32602d8a-fd45-41f4-a54f-83961008751b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:16.688480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 870/1722] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:16 2022] PUT /identity/v3/projects/d60a55aee02a4866b8312e456f69fc65/users/fc0f7339f3d940538891555187fe34ac/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:16.689615 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32602d8a-fd45-41f4-a54f-83961008751b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:16.691667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-32602d8a-fd45-41f4-a54f-83961008751b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:16.897766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 853/1723] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:16.902090 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a93625-fd41-4639-9965-03b8ec7464df None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:16.944202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a93625-fd41-4639-9965-03b8ec7464df None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:16.965990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b2950-6a0f-410b-912b-d2ba441a5d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:16.969120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b2950-6a0f-410b-912b-d2ba441a5d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:16.969431 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b2950-6a0f-410b-912b-d2ba441a5d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:16.969710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b2950-6a0f-410b-912b-d2ba441a5d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:16.970384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b2950-6a0f-410b-912b-d2ba441a5d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:16.971869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32602d8a-fd45-41f4-a54f-83961008751b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:16.982616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b2950-6a0f-410b-912b-d2ba441a5d43 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:16.992814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:17.010888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:17.011366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:17.012990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] PATH_INFO: `/v3/users/f46936e5244744e3b0c849e4506bb88c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:17.018261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46936e5244744e3b0c849e4506bb88c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:17.040382 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:17.106088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 854/1724] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:16 2022] POST /identity/v3/projects => generated 389 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:17.106088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b2950-6a0f-410b-912b-d2ba441a5d43 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:17.151414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46936e5244744e3b0c849e4506bb88c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:17.153401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46936e5244744e3b0c849e4506bb88c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:17.180773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46936e5244744e3b0c849e4506bb88c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:17.202343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46936e5244744e3b0c849e4506bb88c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:17.203411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b74e60ee-f70d-4720-9386-57f60f9c970c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46936e5244744e3b0c849e4506bb88c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:17.235002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 871/1725] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:16 2022] DELETE /identity/v3/users/f46936e5244744e3b0c849e4506bb88c => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:17.237363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b2950-6a0f-410b-912b-d2ba441a5d43 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:17.238481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d5d0d-fe59-44f7-9823-f77406fb5d7e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:17.243909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d5d0d-fe59-44f7-9823-f77406fb5d7e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:17.243909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d5d0d-fe59-44f7-9823-f77406fb5d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:17.325616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2e1d5d0d-fe59-44f7-9823-f77406fb5d7e None None] MFA Rules not processed for user `fc0f7339f3d940538891555187fe34ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:17.327065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2e1d5d0d-fe59-44f7-9823-f77406fb5d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:17.330420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e30d56-2972-4979-9764-950344d0d219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:17.331147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e30d56-2972-4979-9764-950344d0d219 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:17.331644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e30d56-2972-4979-9764-950344d0d219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:17.332260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e30d56-2972-4979-9764-950344d0d219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:17.333074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e30d56-2972-4979-9764-950344d0d219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:17.335586 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e30d56-2972-4979-9764-950344d0d219 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:17.351957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 855/1726] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:17.351957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e30d56-2972-4979-9764-950344d0d219 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:17.352715 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-58e30d56-2972-4979-9764-950344d0d219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:17.366635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:17.449287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:17.490082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e30d56-2972-4979-9764-950344d0d219 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:17.506161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51ff7b-b17b-4865-8c17-26a44cbe0af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:17.507035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51ff7b-b17b-4865-8c17-26a44cbe0af7 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:17.507384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51ff7b-b17b-4865-8c17-26a44cbe0af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:17.507714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51ff7b-b17b-4865-8c17-26a44cbe0af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:17.512996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef51ff7b-b17b-4865-8c17-26a44cbe0af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:17.527599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 872/1727] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:17.530006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d5d0d-fe59-44f7-9823-f77406fb5d7e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:17.531650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2e1d5d0d-fe59-44f7-9823-f77406fb5d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:17.550736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51ff7b-b17b-4865-8c17-26a44cbe0af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:17.552313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51ff7b-b17b-4865-8c17-26a44cbe0af7 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:17.573060 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 856/1728] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:17.574712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51ff7b-b17b-4865-8c17-26a44cbe0af7 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:17.576470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef51ff7b-b17b-4865-8c17-26a44cbe0af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:17.598192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51ff7b-b17b-4865-8c17-26a44cbe0af7 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:17.605656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612046ab-2b01-4c4b-a5eb-e75ba5aefef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:17.606560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612046ab-2b01-4c4b-a5eb-e75ba5aefef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:17.607648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612046ab-2b01-4c4b-a5eb-e75ba5aefef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:17.608115 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612046ab-2b01-4c4b-a5eb-e75ba5aefef4 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:17.609833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612046ab-2b01-4c4b-a5eb-e75ba5aefef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:17.629059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612046ab-2b01-4c4b-a5eb-e75ba5aefef4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:17.653570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d5d0d-fe59-44f7-9823-f77406fb5d7e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:17.661498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56a62c-ef1c-4ac7-bdeb-7de3f9e7c5f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:17.662639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56a62c-ef1c-4ac7-bdeb-7de3f9e7c5f0 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:17.662731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56a62c-ef1c-4ac7-bdeb-7de3f9e7c5f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:17.663235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56a62c-ef1c-4ac7-bdeb-7de3f9e7c5f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:17.667131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dd56a62c-ef1c-4ac7-bdeb-7de3f9e7c5f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:17.667550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 857/1729] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:17 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:17.672180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5115f60-9e82-44bb-a889-87a713b25642 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:17.672727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5115f60-9e82-44bb-a889-87a713b25642 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:17.673206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5115f60-9e82-44bb-a889-87a713b25642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:17.711645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b5115f60-9e82-44bb-a889-87a713b25642 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:17.713345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b5115f60-9e82-44bb-a889-87a713b25642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:17.725204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 858/1730] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:17.726352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5115f60-9e82-44bb-a889-87a713b25642 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:17.728026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b5115f60-9e82-44bb-a889-87a713b25642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:17.743340 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5115f60-9e82-44bb-a889-87a713b25642 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:17.748762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25036974-f07d-4949-b642-dfb688c6e181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:17.749769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25036974-f07d-4949-b642-dfb688c6e181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:17.750273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25036974-f07d-4949-b642-dfb688c6e181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:17.751020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25036974-f07d-4949-b642-dfb688c6e181 admin admin] PATH_INFO: `/v3/projects/1e0c7a247cd74f60be253d23c46bd6e7/users/0a5fd2b4e85d465f95ed60d33a63946c/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:17.785548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25036974-f07d-4949-b642-dfb688c6e181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0c7a247cd74f60be253d23c46bd6e7, user_id=0a5fd2b4e85d465f95ed60d33a63946c, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:17.793773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25036974-f07d-4949-b642-dfb688c6e181 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:17.819437 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56a62c-ef1c-4ac7-bdeb-7de3f9e7c5f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:17.824679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 859/1731] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:17 2022] PUT /identity/v3/projects/1e0c7a247cd74f60be253d23c46bd6e7/users/0a5fd2b4e85d465f95ed60d33a63946c/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:17.828277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312f94d-8d34-4243-a80f-e40f42c3876e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:17.828544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56a62c-ef1c-4ac7-bdeb-7de3f9e7c5f0 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:17.832955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312f94d-8d34-4243-a80f-e40f42c3876e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:17.835345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312f94d-8d34-4243-a80f-e40f42c3876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:17.865219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 873/1732] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:17.866414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56a62c-ef1c-4ac7-bdeb-7de3f9e7c5f0 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:17.868377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dd56a62c-ef1c-4ac7-bdeb-7de3f9e7c5f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:17.913352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b312f94d-8d34-4243-a80f-e40f42c3876e None None] MFA Rules not processed for user `041507d810424dd7b34bff2e347bd52a`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:17.915144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b312f94d-8d34-4243-a80f-e40f42c3876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:18.049755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56a62c-ef1c-4ac7-bdeb-7de3f9e7c5f0 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:18.066370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 860/1733] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:18.067670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312f94d-8d34-4243-a80f-e40f42c3876e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:18.102305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:18.129957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2760f6e-3ecb-44f5-ad6f-a203dd61891b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:18.139708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2760f6e-3ecb-44f5-ad6f-a203dd61891b service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:18.140211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2760f6e-3ecb-44f5-ad6f-a203dd61891b service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:18.140650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2760f6e-3ecb-44f5-ad6f-a203dd61891b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:18.233644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:18.276719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312f94d-8d34-4243-a80f-e40f42c3876e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:18.298964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553908d-2709-45dd-9765-1d3138cdc5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:18.299615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553908d-2709-45dd-9765-1d3138cdc5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:18.299892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553908d-2709-45dd-9765-1d3138cdc5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:18.300162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553908d-2709-45dd-9765-1d3138cdc5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:18.300826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553908d-2709-45dd-9765-1d3138cdc5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:18.302549 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553908d-2709-45dd-9765-1d3138cdc5ef admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:18.331285 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2760f6e-3ecb-44f5-ad6f-a203dd61891b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:18.343873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2760f6e-3ecb-44f5-ad6f-a203dd61891b service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:18.345320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 861/1734] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:18.348700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49162a65-d4e8-4ad1-8e0e-7fccb21d8c5f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:18.349021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49162a65-d4e8-4ad1-8e0e-7fccb21d8c5f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:18.349324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49162a65-d4e8-4ad1-8e0e-7fccb21d8c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:18.369343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 874/1735] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:18.372615 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2760f6e-3ecb-44f5-ad6f-a203dd61891b service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:18.414842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-49162a65-d4e8-4ad1-8e0e-7fccb21d8c5f None None] MFA Rules not processed for user `7ec24d5d0eb041e79b9d9ffa7be8c3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:18.414842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-49162a65-d4e8-4ad1-8e0e-7fccb21d8c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:18.525291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2760f6e-3ecb-44f5-ad6f-a203dd61891b service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:18.530837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4b8e-76f7-41a8-92ed-c83dcb48978f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:18.531941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4b8e-76f7-41a8-92ed-c83dcb48978f service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:18.532323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4b8e-76f7-41a8-92ed-c83dcb48978f service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:18.532695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4b8e-76f7-41a8-92ed-c83dcb48978f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:18.544448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc4b8e-76f7-41a8-92ed-c83dcb48978f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:18.546438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc4b8e-76f7-41a8-92ed-c83dcb48978f service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:18.553958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 862/1736] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:18.555095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49162a65-d4e8-4ad1-8e0e-7fccb21d8c5f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:18.566320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 875/1737] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:18.568450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b25b-7e24-4c41-aa1b-bc7d13a43af3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:18.568624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b25b-7e24-4c41-aa1b-bc7d13a43af3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:18.568872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49162a65-d4e8-4ad1-8e0e-7fccb21d8c5f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:18.569125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824b25b-7e24-4c41-aa1b-bc7d13a43af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:18.574317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeaefb-6099-4560-9fd5-589949256bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:18.575036 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeaefb-6099-4560-9fd5-589949256bef admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:18.575321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeaefb-6099-4560-9fd5-589949256bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:18.575598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeaefb-6099-4560-9fd5-589949256bef admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:18.576416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeaefb-6099-4560-9fd5-589949256bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:18.578226 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeaefb-6099-4560-9fd5-589949256bef admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:18.592122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 863/1738] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:18.593171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9824b25b-7e24-4c41-aa1b-bc7d13a43af3 None None] MFA Rules not processed for user `041507d810424dd7b34bff2e347bd52a`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:18.593302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeaefb-6099-4560-9fd5-589949256bef admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:18.595045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9824b25b-7e24-4c41-aa1b-bc7d13a43af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:18.595559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-deeeaefb-6099-4560-9fd5-589949256bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:18.609863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 876/1739] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:18.611091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b25b-7e24-4c41-aa1b-bc7d13a43af3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:18.625013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824b25b-7e24-4c41-aa1b-bc7d13a43af3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:18.633104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a04eb0-993a-4b92-a65c-cd35c2031bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:18.634150 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04eb0-993a-4b92-a65c-cd35c2031bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:18.635093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04eb0-993a-4b92-a65c-cd35c2031bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:18.635586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04eb0-993a-4b92-a65c-cd35c2031bd8 admin admin] PATH_INFO: `/v3/projects/1614d4a1a30f49779e035d25905eaffd/users/017dbe94da11434194d5790fcd91005e/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:18.656186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a04eb0-993a-4b92-a65c-cd35c2031bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614d4a1a30f49779e035d25905eaffd, user_id=017dbe94da11434194d5790fcd91005e, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:18.659904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a04eb0-993a-4b92-a65c-cd35c2031bd8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:18.685973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 877/1740] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:18 2022] PUT /identity/v3/projects/1614d4a1a30f49779e035d25905eaffd/users/017dbe94da11434194d5790fcd91005e/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:18.690631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167de3-e979-4fe3-a524-9eb99acf5746 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:18.690937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167de3-e979-4fe3-a524-9eb99acf5746 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:18.691222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d167de3-e979-4fe3-a524-9eb99acf5746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:18.724112 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeaefb-6099-4560-9fd5-589949256bef admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:18.740785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6d167de3-e979-4fe3-a524-9eb99acf5746 None None] MFA Rules not processed for user `2b29780489334bb6807674a8c4ea5239`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:18.744605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6d167de3-e979-4fe3-a524-9eb99acf5746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:18.862836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f64af-3638-4a9c-877a-def478893591 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4716f9539151414dadd9e4b8f13ffc0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:18.863636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f64af-3638-4a9c-877a-def478893591 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:18.864050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f64af-3638-4a9c-877a-def478893591 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:18.864448 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f64af-3638-4a9c-877a-def478893591 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:18.868683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-660f64af-3638-4a9c-877a-def478893591 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:18.893757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 878/1741] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:18.895504 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d167de3-e979-4fe3-a524-9eb99acf5746 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:18.899615 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f64af-3638-4a9c-877a-def478893591 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:18.901398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f64af-3638-4a9c-877a-def478893591 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:18.902034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:18.910082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:18.922402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 864/1742] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:18.923405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f64af-3638-4a9c-877a-def478893591 service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:18.928103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-660f64af-3638-4a9c-877a-def478893591 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:19.075190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f64af-3638-4a9c-877a-def478893591 service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:19.085889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef87844-e61c-4be3-9072-d1f11b0cd317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:19.086517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef87844-e61c-4be3-9072-d1f11b0cd317 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:19.086794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef87844-e61c-4be3-9072-d1f11b0cd317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:19.087094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef87844-e61c-4be3-9072-d1f11b0cd317 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:19.087699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef87844-e61c-4be3-9072-d1f11b0cd317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:19.088581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d167de3-e979-4fe3-a524-9eb99acf5746 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:19.089655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef87844-e61c-4be3-9072-d1f11b0cd317 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:19.102830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1f51a-9ec9-4d96-9701-4ca4f3747e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:19.104167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f51a-9ec9-4d96-9701-4ca4f3747e6b service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:19.104607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f51a-9ec9-4d96-9701-4ca4f3747e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:19.105119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f51a-9ec9-4d96-9701-4ca4f3747e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:19.108720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3cc1f51a-9ec9-4d96-9701-4ca4f3747e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:19.165430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 865/1743] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:18 2022] POST /identity/v3/projects => generated 403 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:19.165430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef87844-e61c-4be3-9072-d1f11b0cd317 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:19.306482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef87844-e61c-4be3-9072-d1f11b0cd317 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:19.313736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04885bc-c275-4237-8108-5212924ad809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:19.314391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04885bc-c275-4237-8108-5212924ad809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:19.314800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04885bc-c275-4237-8108-5212924ad809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:19.315084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04885bc-c275-4237-8108-5212924ad809 admin admin] PATH_INFO: `/v3/projects/1e0c7a247cd74f60be253d23c46bd6e7/users/0a5fd2b4e85d465f95ed60d33a63946c/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:19.319371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1f51a-9ec9-4d96-9701-4ca4f3747e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:19.321560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1f51a-9ec9-4d96-9701-4ca4f3747e6b service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:19.326634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04885bc-c275-4237-8108-5212924ad809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0c7a247cd74f60be253d23c46bd6e7, user_id=0a5fd2b4e85d465f95ed60d33a63946c, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:19.330024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04885bc-c275-4237-8108-5212924ad809 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:19.343887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 879/1744] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:19.346890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1f51a-9ec9-4d96-9701-4ca4f3747e6b service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:19.351701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3cc1f51a-9ec9-4d96-9701-4ca4f3747e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:19.352416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 866/1745] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:19 2022] PUT /identity/v3/projects/1e0c7a247cd74f60be253d23c46bd6e7/users/0a5fd2b4e85d465f95ed60d33a63946c/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:19.360544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04885bc-c275-4237-8108-5212924ad809 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:19.508131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04885bc-c275-4237-8108-5212924ad809 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:19.519434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d31c2-6790-4c5b-9770-23e65d0b37aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:19.520108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d31c2-6790-4c5b-9770-23e65d0b37aa admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:19.520390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d31c2-6790-4c5b-9770-23e65d0b37aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:19.520658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d31c2-6790-4c5b-9770-23e65d0b37aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:19.521356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d31c2-6790-4c5b-9770-23e65d0b37aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:19.522951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d31c2-6790-4c5b-9770-23e65d0b37aa admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:19.545088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 867/1746] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:19.548635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d31c2-6790-4c5b-9770-23e65d0b37aa admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:19.551974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1f51a-9ec9-4d96-9701-4ca4f3747e6b service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:19.568144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d31c2-6790-4c5b-9770-23e65d0b37aa admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:19.580444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10cc77-12de-44f8-a742-4bed6a1581a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:19.581100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10cc77-12de-44f8-a742-4bed6a1581a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:19.581380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10cc77-12de-44f8-a742-4bed6a1581a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:19.581702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10cc77-12de-44f8-a742-4bed6a1581a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:19.582279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10cc77-12de-44f8-a742-4bed6a1581a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:19.584338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10cc77-12de-44f8-a742-4bed6a1581a3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:19.634844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:19.641629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 868/1747] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:19 2022] POST /identity/v3/users => generated 308 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:19.642907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe4f5-0ba8-4a5c-98c1-76a7f573bee7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:19.643186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe4f5-0ba8-4a5c-98c1-76a7f573bee7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:19.643449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefe4f5-0ba8-4a5c-98c1-76a7f573bee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:19.710545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4eefe4f5-0ba8-4a5c-98c1-76a7f573bee7 None None] MFA Rules not processed for user `0a5fd2b4e85d465f95ed60d33a63946c`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:19.713356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4eefe4f5-0ba8-4a5c-98c1-76a7f573bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:19.768830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:19.804366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590264d-a9e9-4470-bcdb-113b3dba6d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:19.805293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590264d-a9e9-4470-bcdb-113b3dba6d3d service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:19.806435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590264d-a9e9-4470-bcdb-113b3dba6d3d service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:19.806855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590264d-a9e9-4470-bcdb-113b3dba6d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:19.894560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 869/1748] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:19.895734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefe4f5-0ba8-4a5c-98c1-76a7f573bee7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:19.897240 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4eefe4f5-0ba8-4a5c-98c1-76a7f573bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:19.930191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefe4f5-0ba8-4a5c-98c1-76a7f573bee7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:19.943490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:19.944339 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:19.944728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:19.945097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590264d-a9e9-4470-bcdb-113b3dba6d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:19.945226 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] PATH_INFO: `/v3/projects/94a23a7a236d481a92d501a2a23ee617` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:19.946880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a23a7a236d481a92d501a2a23ee617)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:19.948187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590264d-a9e9-4470-bcdb-113b3dba6d3d service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:19.950080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:19.966097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 880/1749] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:19.968598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590264d-a9e9-4470-bcdb-113b3dba6d3d service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:19.986060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590264d-a9e9-4470-bcdb-113b3dba6d3d service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:19.994115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db14417-a062-4249-87ab-4a35fc082414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:19.994825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14417-a062-4249-87ab-4a35fc082414 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:19.995326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14417-a062-4249-87ab-4a35fc082414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:19.995707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db14417-a062-4249-87ab-4a35fc082414 admin admin] PATH_INFO: `/v3/projects/1614d4a1a30f49779e035d25905eaffd/users/017dbe94da11434194d5790fcd91005e/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:19.999968 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db14417-a062-4249-87ab-4a35fc082414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614d4a1a30f49779e035d25905eaffd, user_id=017dbe94da11434194d5790fcd91005e, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:20.004270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db14417-a062-4249-87ab-4a35fc082414 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:20.034474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 881/1750] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:19 2022] PUT /identity/v3/projects/1614d4a1a30f49779e035d25905eaffd/users/017dbe94da11434194d5790fcd91005e/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:20.034474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ee45d-1725-4c64-a7df-3b9b9587e350 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:20.034474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ee45d-1725-4c64-a7df-3b9b9587e350 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:20.034474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ee45d-1725-4c64-a7df-3b9b9587e350 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:20.036065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 882/1751] 10.222.0.76 () {54 vars in 912 bytes} [Mon Sep 19 17:10:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:10:20.037262 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ee45d-1725-4c64-a7df-3b9b9587e350 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:20.115627 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a23a7a236d481a92d501a2a23ee617', 'request_id': 'req-f26342e9-1abb-483f-a557-8d41762f0771'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:20.122511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a23a7a236d481a92d501a2a23ee617', 'request_id': 'req-f26342e9-1abb-483f-a557-8d41762f0771'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:20.138398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a23a7a236d481a92d501a2a23ee617', 'request_id': 'req-f26342e9-1abb-483f-a557-8d41762f0771'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:20.159702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] The token cache is being invalidate because project 94a23a7a236d481a92d501a2a23ee617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:20.160153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:20.161870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:20.170075 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 870/1752] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:19 2022] DELETE /identity/v3/projects/94a23a7a236d481a92d501a2a23ee617 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:20.171711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:20.175892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:20.177976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ee45d-1725-4c64-a7df-3b9b9587e350 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:20.341435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ac105-1f14-4472-9a66-04b1c8fe125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:20.342447 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ac105-1f14-4472-9a66-04b1c8fe125d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:20.344078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ac105-1f14-4472-9a66-04b1c8fe125d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:20.344433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ac105-1f14-4472-9a66-04b1c8fe125d admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:20.344634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26342e9-1abb-483f-a557-8d41762f0771 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:20.346547 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ac105-1f14-4472-9a66-04b1c8fe125d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:20.350700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa620a10-ac4e-4f4f-b087-79ec9153d4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:20.351502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa620a10-ac4e-4f4f-b087-79ec9153d4ae service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:20.351922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa620a10-ac4e-4f4f-b087-79ec9153d4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:20.352413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa620a10-ac4e-4f4f-b087-79ec9153d4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:20.355734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aa620a10-ac4e-4f4f-b087-79ec9153d4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:20.355828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ac105-1f14-4472-9a66-04b1c8fe125d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:20.376093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 883/1753] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:20.376093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fc8a1-8ff9-453b-a606-766221a0a374 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:20.376093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fc8a1-8ff9-453b-a606-766221a0a374 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:20.376093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fc8a1-8ff9-453b-a606-766221a0a374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:20.397256 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:20.428985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bb8fc8a1-8ff9-453b-a606-766221a0a374 None None] MFA Rules not processed for user `017dbe94da11434194d5790fcd91005e`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:20.430440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bb8fc8a1-8ff9-453b-a606-766221a0a374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:20.446569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:20.504701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa620a10-ac4e-4f4f-b087-79ec9153d4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:20.515360 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa620a10-ac4e-4f4f-b087-79ec9153d4ae service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:20.538538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 871/1754] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:20.540996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422e07-74de-4052-8187-68418c9fdcba None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:20.542260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422e07-74de-4052-8187-68418c9fdcba None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:20.542541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7422e07-74de-4052-8187-68418c9fdcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:20.622139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b7422e07-74de-4052-8187-68418c9fdcba None None] MFA Rules not processed for user `da4a83dd0cb64e219bc16f8cf0b0af57`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:20.625396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b7422e07-74de-4052-8187-68418c9fdcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:20.627207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 884/1755] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:20.642057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb611-68fc-41d3-857f-58e42054ce52 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:20.642346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb611-68fc-41d3-857f-58e42054ce52 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:20.642624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb611-68fc-41d3-857f-58e42054ce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:20.734040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4e0bb611-68fc-41d3-857f-58e42054ce52 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:20.740157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4e0bb611-68fc-41d3-857f-58e42054ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:20.770071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 885/1756] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:20.771927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb611-68fc-41d3-857f-58e42054ce52 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:20.774415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4e0bb611-68fc-41d3-857f-58e42054ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:20.801479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb611-68fc-41d3-857f-58e42054ce52 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:20.810680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 872/1757] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:20.811686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422e07-74de-4052-8187-68418c9fdcba None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:20.814336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba56003-ee99-427b-a63c-f768494ef43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:20.815046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba56003-ee99-427b-a63c-f768494ef43b admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:20.815330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba56003-ee99-427b-a63c-f768494ef43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:20.815592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba56003-ee99-427b-a63c-f768494ef43b admin admin] PATH_INFO: `/v3/projects/b9385c1c58e9450c8e70b2ab2f789b37/users/e9ee8811051e42fda58065defb57fc20/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:20.837956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7422e07-74de-4052-8187-68418c9fdcba None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:20.849893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6a2c7-9d63-435d-8070-bc5670fe7dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:20.850819 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6a2c7-9d63-435d-8070-bc5670fe7dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:20.853763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba56003-ee99-427b-a63c-f768494ef43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9385c1c58e9450c8e70b2ab2f789b37, user_id=e9ee8811051e42fda58065defb57fc20, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:20.856621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba56003-ee99-427b-a63c-f768494ef43b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:20.858496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6a2c7-9d63-435d-8070-bc5670fe7dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:20.858845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6a2c7-9d63-435d-8070-bc5670fe7dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:20.877979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6a2c7-9d63-435d-8070-bc5670fe7dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:20.879499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6a2c7-9d63-435d-8070-bc5670fe7dc9 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:20.894476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 886/1758] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:20 2022] PUT /identity/v3/projects/b9385c1c58e9450c8e70b2ab2f789b37/users/e9ee8811051e42fda58065defb57fc20/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:20.902456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba56003-ee99-427b-a63c-f768494ef43b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:20.906127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3ba56003-ee99-427b-a63c-f768494ef43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:20.928753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 873/1759] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:20.930308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d2be1-b56b-4ef2-818a-6a4e440eeac0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:20.936562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d2be1-b56b-4ef2-818a-6a4e440eeac0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:20.939033 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d2be1-b56b-4ef2-818a-6a4e440eeac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:21.039236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f55d2be1-b56b-4ef2-818a-6a4e440eeac0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:21.052957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f55d2be1-b56b-4ef2-818a-6a4e440eeac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:21.188918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba56003-ee99-427b-a63c-f768494ef43b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:21.213166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6048e3-0ca2-4d2e-8aaa-bad080436fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:21.214889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6048e3-0ca2-4d2e-8aaa-bad080436fcf service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:21.215640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6048e3-0ca2-4d2e-8aaa-bad080436fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:21.216025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6048e3-0ca2-4d2e-8aaa-bad080436fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:21.219590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bb6048e3-0ca2-4d2e-8aaa-bad080436fcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:21.331691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 874/1760] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:21.334495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d2be1-b56b-4ef2-818a-6a4e440eeac0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:21.342537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f55d2be1-b56b-4ef2-818a-6a4e440eeac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:21.391968 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6048e3-0ca2-4d2e-8aaa-bad080436fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:21.396502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6048e3-0ca2-4d2e-8aaa-bad080436fcf service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:21.442178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 887/1761] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:21.488151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6048e3-0ca2-4d2e-8aaa-bad080436fcf service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:21.544397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6048e3-0ca2-4d2e-8aaa-bad080436fcf service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:21.560239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78b51c-f3e7-4803-8b86-5fd5897b330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:21.562920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b51c-f3e7-4803-8b86-5fd5897b330e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:21.563272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b51c-f3e7-4803-8b86-5fd5897b330e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:21.563607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78b51c-f3e7-4803-8b86-5fd5897b330e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:21.565952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78b51c-f3e7-4803-8b86-5fd5897b330e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:21.570085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78b51c-f3e7-4803-8b86-5fd5897b330e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:21.583368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d2be1-b56b-4ef2-818a-6a4e440eeac0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:21.600893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462435c-2284-4694-8fe8-889eed7c6463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:21.601623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462435c-2284-4694-8fe8-889eed7c6463 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:21.603590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462435c-2284-4694-8fe8-889eed7c6463 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:21.603590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462435c-2284-4694-8fe8-889eed7c6463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:21.616742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:21.619060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 888/1762] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:21.620904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78b51c-f3e7-4803-8b86-5fd5897b330e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:21.628863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462435c-2284-4694-8fe8-889eed7c6463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:21.632032 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462435c-2284-4694-8fe8-889eed7c6463 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:21.656164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 875/1763] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:21.657068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462435c-2284-4694-8fe8-889eed7c6463 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:21.694959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462435c-2284-4694-8fe8-889eed7c6463 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:21.711658 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78b51c-f3e7-4803-8b86-5fd5897b330e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:21.718918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e819c-e113-4323-9a8e-a191501eb3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:21.738073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e819c-e113-4323-9a8e-a191501eb3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:21.738073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e819c-e113-4323-9a8e-a191501eb3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:21.738073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e819c-e113-4323-9a8e-a191501eb3b2 admin admin] PATH_INFO: `/v3/projects/b9385c1c58e9450c8e70b2ab2f789b37/users/e9ee8811051e42fda58065defb57fc20/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:21.743579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dcfc3-605c-4efb-91be-c933ea53423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:21.744220 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcfc3-605c-4efb-91be-c933ea53423d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:21.744664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcfc3-605c-4efb-91be-c933ea53423d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:21.744946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dcfc3-605c-4efb-91be-c933ea53423d admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:21.745633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dcfc3-605c-4efb-91be-c933ea53423d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:21.746618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dcfc3-605c-4efb-91be-c933ea53423d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:21.747747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dcfc3-605c-4efb-91be-c933ea53423d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:21.749868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e819c-e113-4323-9a8e-a191501eb3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9385c1c58e9450c8e70b2ab2f789b37, user_id=e9ee8811051e42fda58065defb57fc20, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:21.770354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e819c-e113-4323-9a8e-a191501eb3b2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:21.787066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 889/1764] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:21.787066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dcfc3-605c-4efb-91be-c933ea53423d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:21.792521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f66dcfc3-605c-4efb-91be-c933ea53423d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:21.824983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dcfc3-605c-4efb-91be-c933ea53423d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:21.830232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 876/1765] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:21 2022] PUT /identity/v3/projects/b9385c1c58e9450c8e70b2ab2f789b37/users/e9ee8811051e42fda58065defb57fc20/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:21.830384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:21.834545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e819c-e113-4323-9a8e-a191501eb3b2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:21.960182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:21.960980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:21.961298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:21.961573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] PATH_INFO: `/v3/users/b09e69139f1746a586325fdc3262394c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:21.963173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b09e69139f1746a586325fdc3262394c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:21.966738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:22.081594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b09e69139f1746a586325fdc3262394c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:22.086246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b09e69139f1746a586325fdc3262394c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:22.108405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e819c-e113-4323-9a8e-a191501eb3b2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:22.124594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4616f-fe7e-46a3-aa7a-1c6fce780b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:22.125279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4616f-fe7e-46a3-aa7a-1c6fce780b00 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:22.129519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4616f-fe7e-46a3-aa7a-1c6fce780b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:22.130833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4616f-fe7e-46a3-aa7a-1c6fce780b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:22.132817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4616f-fe7e-46a3-aa7a-1c6fce780b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:22.139463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4616f-fe7e-46a3-aa7a-1c6fce780b00 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:22.162971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b09e69139f1746a586325fdc3262394c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:22.195995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b09e69139f1746a586325fdc3262394c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:22.197939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f3c3456c-5b5c-423e-95cd-5b1ce4e744da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b09e69139f1746a586325fdc3262394c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:22.232333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 890/1766] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:21 2022] DELETE /identity/v3/users/b09e69139f1746a586325fdc3262394c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:22.233684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17964a-9dbc-4cfd-9ca2-395a5820363d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:22.233971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17964a-9dbc-4cfd-9ca2-395a5820363d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:22.237632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17964a-9dbc-4cfd-9ca2-395a5820363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:22.262038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 877/1767] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:21 2022] POST /identity/v3/projects => generated 379 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:22.262316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3f613-e6b2-4b27-abfd-e8c63ec252d5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:22.264972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3f613-e6b2-4b27-abfd-e8c63ec252d5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:22.265347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3f613-e6b2-4b27-abfd-e8c63ec252d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:22.319058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bf17964a-9dbc-4cfd-9ca2-395a5820363d None None] MFA Rules not processed for user `58005342342744a98bbfe8ed97ad151b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:22.321146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bf17964a-9dbc-4cfd-9ca2-395a5820363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:22.368188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b0a3f613-e6b2-4b27-abfd-e8c63ec252d5 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:22.372538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b0a3f613-e6b2-4b27-abfd-e8c63ec252d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:22.540081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 891/1768] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:22.544751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17964a-9dbc-4cfd-9ca2-395a5820363d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:22.549835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bf17964a-9dbc-4cfd-9ca2-395a5820363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:22.610807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 878/1769] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:22.655266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3f613-e6b2-4b27-abfd-e8c63ec252d5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:22.657356 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b0a3f613-e6b2-4b27-abfd-e8c63ec252d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:22.743141 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:22.874265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17964a-9dbc-4cfd-9ca2-395a5820363d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:22.883497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3f613-e6b2-4b27-abfd-e8c63ec252d5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:22.909871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cfe8e-42a8-44ba-ac09-82b2d4bec9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:22.910517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cfe8e-42a8-44ba-ac09-82b2d4bec9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:22.913367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cfe8e-42a8-44ba-ac09-82b2d4bec9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:22.913662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cfe8e-42a8-44ba-ac09-82b2d4bec9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:22.920955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d7b4-e42a-434e-9405-d52adecb9153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:22.933007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d7b4-e42a-434e-9405-d52adecb9153 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:22.933426 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d7b4-e42a-434e-9405-d52adecb9153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:22.933623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d7b4-e42a-434e-9405-d52adecb9153 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:22.934587 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06d7b4-e42a-434e-9405-d52adecb9153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:22.936558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06d7b4-e42a-434e-9405-d52adecb9153 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:22.942239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cfe8e-42a8-44ba-ac09-82b2d4bec9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:22.943722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cfe8e-42a8-44ba-ac09-82b2d4bec9d6 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:22.992773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 879/1770] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:10:23.040341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5fe62-1273-44d0-ae30-7968a48e78a2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:23.040631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5fe62-1273-44d0-ae30-7968a48e78a2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:23.040910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5fe62-1273-44d0-ae30-7968a48e78a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:23.066333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 892/1771] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:22 2022] POST /identity/v3/users => generated 290 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:23.068912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d7b4-e42a-434e-9405-d52adecb9153 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:23.105300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:23.112540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d7b4-e42a-434e-9405-d52adecb9153 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:23.129106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52466bf6-d73b-4d2e-a9d5-e2064c79ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:23.130741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52466bf6-d73b-4d2e-a9d5-e2064c79ef82 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:23.132423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52466bf6-d73b-4d2e-a9d5-e2064c79ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:23.132917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52466bf6-d73b-4d2e-a9d5-e2064c79ef82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:23.133821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52466bf6-d73b-4d2e-a9d5-e2064c79ef82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:23.140293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52466bf6-d73b-4d2e-a9d5-e2064c79ef82 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:23.165071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 893/1772] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:23.176421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52466bf6-d73b-4d2e-a9d5-e2064c79ef82 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:23.221282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-27d5fe62-1273-44d0-ae30-7968a48e78a2 None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:23.222780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-27d5fe62-1273-44d0-ae30-7968a48e78a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:23.236676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52466bf6-d73b-4d2e-a9d5-e2064c79ef82 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:23.284651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eaaf6-f23f-4b39-a186-fe79dab55584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:23.285645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eaaf6-f23f-4b39-a186-fe79dab55584 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:23.286182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eaaf6-f23f-4b39-a186-fe79dab55584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:23.287018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eaaf6-f23f-4b39-a186-fe79dab55584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:23.288491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eaaf6-f23f-4b39-a186-fe79dab55584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:23.290448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69eaaf6-f23f-4b39-a186-fe79dab55584 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:23.322005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 894/1773] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:23.326343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eaaf6-f23f-4b39-a186-fe79dab55584 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:23.352337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eaaf6-f23f-4b39-a186-fe79dab55584 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:23.361354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996d9a-7ad6-4a98-81ef-1f22dc3ceb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:23.362390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996d9a-7ad6-4a98-81ef-1f22dc3ceb0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:23.362851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996d9a-7ad6-4a98-81ef-1f22dc3ceb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:23.363324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15996d9a-7ad6-4a98-81ef-1f22dc3ceb0f admin admin] PATH_INFO: `/v3/projects/d78c51c7a78c48d494ea825499bb1e0e/users/cbda4797c0f44f3980dd35b758fc767b/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:23.407993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15996d9a-7ad6-4a98-81ef-1f22dc3ceb0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d78c51c7a78c48d494ea825499bb1e0e, user_id=cbda4797c0f44f3980dd35b758fc767b, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:23.412725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15996d9a-7ad6-4a98-81ef-1f22dc3ceb0f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:23.427277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 880/1774] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:10:23.448575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 895/1775] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:23 2022] PUT /identity/v3/projects/d78c51c7a78c48d494ea825499bb1e0e/users/cbda4797c0f44f3980dd35b758fc767b/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:23.462155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3c581-6934-44e2-9a16-644b5168db35 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:23.462155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3c581-6934-44e2-9a16-644b5168db35 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:23.462155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3c581-6934-44e2-9a16-644b5168db35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:23.596587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-69d3c581-6934-44e2-9a16-644b5168db35 None None] MFA Rules not processed for user `cbda4797c0f44f3980dd35b758fc767b`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:23.636373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-69d3c581-6934-44e2-9a16-644b5168db35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:23.749517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996d9a-7ad6-4a98-81ef-1f22dc3ceb0f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:23.751451 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-15996d9a-7ad6-4a98-81ef-1f22dc3ceb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:23.883143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 881/1776] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:23.887826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3c581-6934-44e2-9a16-644b5168db35 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:24.135396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3c581-6934-44e2-9a16-644b5168db35 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:24.148069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15996d9a-7ad6-4a98-81ef-1f22dc3ceb0f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:24.157946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a668e-d6d0-4452-9214-dccbea7283c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:24.158971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a668e-d6d0-4452-9214-dccbea7283c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:24.160913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a668e-d6d0-4452-9214-dccbea7283c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:24.161441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a668e-d6d0-4452-9214-dccbea7283c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:24.162694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a668e-d6d0-4452-9214-dccbea7283c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:24.169145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a668e-d6d0-4452-9214-dccbea7283c2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:24.171052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd23572-e6df-4be6-b895-93319662b381 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:24.171052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd23572-e6df-4be6-b895-93319662b381 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:24.171052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd23572-e6df-4be6-b895-93319662b381 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:24.174414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd23572-e6df-4be6-b895-93319662b381 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:24.236461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:24.256026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 882/1777] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:23 2022] POST /identity/v3/projects => generated 377 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:24.262686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a668e-d6d0-4452-9214-dccbea7283c2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:24.276334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-449a668e-d6d0-4452-9214-dccbea7283c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:24.387430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:24.399684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd23572-e6df-4be6-b895-93319662b381 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:24.406105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd23572-e6df-4be6-b895-93319662b381 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:24.449481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 896/1778] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:10:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 17:10:24.451751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd23572-e6df-4be6-b895-93319662b381 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:24.473127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd23572-e6df-4be6-b895-93319662b381 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:24.485203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569f7b5-7b04-4b86-98d1-29ceefcfbc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:24.485912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569f7b5-7b04-4b86-98d1-29ceefcfbc1f admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:24.486373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569f7b5-7b04-4b86-98d1-29ceefcfbc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:24.486731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569f7b5-7b04-4b86-98d1-29ceefcfbc1f admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:24.488202 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569f7b5-7b04-4b86-98d1-29ceefcfbc1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:24.490763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569f7b5-7b04-4b86-98d1-29ceefcfbc1f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:24.511059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a668e-d6d0-4452-9214-dccbea7283c2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:24.541009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:24.543586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 897/1779] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:24 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:24.546382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:24.549314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:24.550699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569f7b5-7b04-4b86-98d1-29ceefcfbc1f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:24.551457 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] PATH_INFO: `/v3/users/9c5011e4eaed42889884b7a5365b599a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:24.555901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c5011e4eaed42889884b7a5365b599a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:24.565902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:24.573825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569f7b5-7b04-4b86-98d1-29ceefcfbc1f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:24.583760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677f06-d15b-4d72-9d87-aea5de2611c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:24.585177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677f06-d15b-4d72-9d87-aea5de2611c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:24.585409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677f06-d15b-4d72-9d87-aea5de2611c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:24.586597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94677f06-d15b-4d72-9d87-aea5de2611c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:24.587466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677f06-d15b-4d72-9d87-aea5de2611c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:24.589479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94677f06-d15b-4d72-9d87-aea5de2611c5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:24.608689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 898/1780] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:24.614270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677f06-d15b-4d72-9d87-aea5de2611c5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:24.634012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94677f06-d15b-4d72-9d87-aea5de2611c5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:24.644039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c16e5-16bb-40ea-b62c-2e88de9e63af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:24.646169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c16e5-16bb-40ea-b62c-2e88de9e63af admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:24.647332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c16e5-16bb-40ea-b62c-2e88de9e63af admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:24.648549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c16e5-16bb-40ea-b62c-2e88de9e63af admin admin] PATH_INFO: `/v3/projects/337b5e6d43e14d748b388f2f6be1c19d/users/093aca917a224302bbe189618ea6cb26/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:24.683580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c16e5-16bb-40ea-b62c-2e88de9e63af admin admin] RBAC: Authorizing `identity:create_grant(project_id=337b5e6d43e14d748b388f2f6be1c19d, user_id=093aca917a224302bbe189618ea6cb26, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:24.688686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c16e5-16bb-40ea-b62c-2e88de9e63af admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:24.709439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c5011e4eaed42889884b7a5365b599a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:24.730209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c5011e4eaed42889884b7a5365b599a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:24.731289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c5011e4eaed42889884b7a5365b599a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:24.747173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 899/1781] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:24 2022] PUT /identity/v3/projects/337b5e6d43e14d748b388f2f6be1c19d/users/093aca917a224302bbe189618ea6cb26/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:24.749941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c16e5-16bb-40ea-b62c-2e88de9e63af admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:24.756908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c5011e4eaed42889884b7a5365b599a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:24.757997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45ab0a7d-7e4b-4d36-9bd3-81eae145ba88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c5011e4eaed42889884b7a5365b599a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:24.792490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 883/1782] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:24 2022] DELETE /identity/v3/users/9c5011e4eaed42889884b7a5365b599a => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:24.798244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce7f3-47d3-4d3d-8403-b6c572810cf4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:24.798881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce7f3-47d3-4d3d-8403-b6c572810cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:24.799388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ce7f3-47d3-4d3d-8403-b6c572810cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:24.837963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ee7ce7f3-47d3-4d3d-8403-b6c572810cf4 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:24.841409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ee7ce7f3-47d3-4d3d-8403-b6c572810cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:24.954978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c16e5-16bb-40ea-b62c-2e88de9e63af admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:24.972450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 884/1783] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:25.046249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ce7f3-47d3-4d3d-8403-b6c572810cf4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:25.048088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ee7ce7f3-47d3-4d3d-8403-b6c572810cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:25.129050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:25.213076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee1e3f-1515-4760-bcac-4c90a31aaea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:25.220678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee1e3f-1515-4760-bcac-4c90a31aaea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:25.221177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee1e3f-1515-4760-bcac-4c90a31aaea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:25.221550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee1e3f-1515-4760-bcac-4c90a31aaea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:25.223708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee1e3f-1515-4760-bcac-4c90a31aaea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:25.225715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee1e3f-1515-4760-bcac-4c90a31aaea9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:25.263901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 900/1784] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:25.268396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee1e3f-1515-4760-bcac-4c90a31aaea9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:25.277277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-64ee1e3f-1515-4760-bcac-4c90a31aaea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:25.329699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ce7f3-47d3-4d3d-8403-b6c572810cf4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:25.337833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee1e3f-1515-4760-bcac-4c90a31aaea9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:25.338802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23411e3c-5e3c-41f6-96af-765aac503637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:25.340567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23411e3c-5e3c-41f6-96af-765aac503637 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:25.341454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23411e3c-5e3c-41f6-96af-765aac503637 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:25.342282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23411e3c-5e3c-41f6-96af-765aac503637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:25.354164 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6b604-0652-4dac-9eb7-175de6b16133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:25.354714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6b604-0652-4dac-9eb7-175de6b16133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:25.354998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6b604-0652-4dac-9eb7-175de6b16133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:25.355279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6b604-0652-4dac-9eb7-175de6b16133 admin admin] PATH_INFO: `/v3/projects/337b5e6d43e14d748b388f2f6be1c19d/users/093aca917a224302bbe189618ea6cb26/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:25.359666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6b604-0652-4dac-9eb7-175de6b16133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337b5e6d43e14d748b388f2f6be1c19d, user_id=093aca917a224302bbe189618ea6cb26, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:25.362826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6b604-0652-4dac-9eb7-175de6b16133 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:25.366436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23411e3c-5e3c-41f6-96af-765aac503637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:25.368166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23411e3c-5e3c-41f6-96af-765aac503637 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:25.421686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 901/1785] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:25 2022] PUT /identity/v3/projects/337b5e6d43e14d748b388f2f6be1c19d/users/093aca917a224302bbe189618ea6cb26/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:25.421945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 885/1786] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:10:25.425234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964d150-ee16-4a9d-b55c-ce4cd1943e4f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:25.425792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964d150-ee16-4a9d-b55c-ce4cd1943e4f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:25.426747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964d150-ee16-4a9d-b55c-ce4cd1943e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:25.530094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7964d150-ee16-4a9d-b55c-ce4cd1943e4f None None] MFA Rules not processed for user `093aca917a224302bbe189618ea6cb26`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:25.541212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7964d150-ee16-4a9d-b55c-ce4cd1943e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:25.622207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:25.813470 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 902/1787] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:25.822791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23411e3c-5e3c-41f6-96af-765aac503637 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:25.824711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-23411e3c-5e3c-41f6-96af-765aac503637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:25.985291 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23411e3c-5e3c-41f6-96af-765aac503637 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:26.039430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430abe13-dba5-4297-a137-ee694b584190 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:26.039907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430abe13-dba5-4297-a137-ee694b584190 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:26.040929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430abe13-dba5-4297-a137-ee694b584190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:26.134538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-430abe13-dba5-4297-a137-ee694b584190 None None] MFA Rules not processed for user `e9ee8811051e42fda58065defb57fc20`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:26.136045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-430abe13-dba5-4297-a137-ee694b584190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:26.198014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a22cf6-ece1-43a5-9fe5-497fdd06f8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:26.198689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a22cf6-ece1-43a5-9fe5-497fdd06f8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:26.204426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a22cf6-ece1-43a5-9fe5-497fdd06f8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:26.204712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a22cf6-ece1-43a5-9fe5-497fdd06f8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:26.211697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-33a22cf6-ece1-43a5-9fe5-497fdd06f8f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:26.468721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 903/1788] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:26.470871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430abe13-dba5-4297-a137-ee694b584190 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:26.477946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-430abe13-dba5-4297-a137-ee694b584190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:26.539373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a22cf6-ece1-43a5-9fe5-497fdd06f8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:26.544830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a22cf6-ece1-43a5-9fe5-497fdd06f8f3 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:26.586508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 886/1789] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:26.912423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430abe13-dba5-4297-a137-ee694b584190 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:26.964987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:26.967473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:26.973831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:26.975398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] PATH_INFO: `/v3/projects/881718e5796444408d4024fbe83a4eb2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:26.980009 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=881718e5796444408d4024fbe83a4eb2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:26.983498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:27.209177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:27.228580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881718e5796444408d4024fbe83a4eb2', 'request_id': 'req-d0dbc172-469b-4fe6-8642-f35523f36105'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:27.253642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881718e5796444408d4024fbe83a4eb2', 'request_id': 'req-d0dbc172-469b-4fe6-8642-f35523f36105'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:27.307140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881718e5796444408d4024fbe83a4eb2', 'request_id': 'req-d0dbc172-469b-4fe6-8642-f35523f36105'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:27.324867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21036c-f5b6-490f-ad47-662aa6b39c19 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:27.325499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21036c-f5b6-490f-ad47-662aa6b39c19 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:27.330369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21036c-f5b6-490f-ad47-662aa6b39c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:27.350118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] The token cache is being invalidate because project 881718e5796444408d4024fbe83a4eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:27.352398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:27.357594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:27.370877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 904/1790] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:26 2022] DELETE /identity/v3/projects/881718e5796444408d4024fbe83a4eb2 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:27.372051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:27.376358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:27.393450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8b21036c-f5b6-490f-ad47-662aa6b39c19 None None] MFA Rules not processed for user `da4a83dd0cb64e219bc16f8cf0b0af57`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:27.396091 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8b21036c-f5b6-490f-ad47-662aa6b39c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:27.498267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:27.542137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dbc172-469b-4fe6-8642-f35523f36105 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:27.557461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:27.558626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:27.559140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:27.559524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] PATH_INFO: `/v3/users/017dbe94da11434194d5790fcd91005e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:27.562682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=017dbe94da11434194d5790fcd91005e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:27.567493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:27.581676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 887/1791] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Sep 19 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:27.664923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21036c-f5b6-490f-ad47-662aa6b39c19 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:27.664923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8b21036c-f5b6-490f-ad47-662aa6b39c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:27.679536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21036c-f5b6-490f-ad47-662aa6b39c19 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:27.702736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0cd25-5acd-4b15-a4f6-bc4468dd80e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:27.709914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0cd25-5acd-4b15-a4f6-bc4468dd80e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:27.711619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0cd25-5acd-4b15-a4f6-bc4468dd80e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:27.712318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0cd25-5acd-4b15-a4f6-bc4468dd80e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:27.733861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017dbe94da11434194d5790fcd91005e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:27.736656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017dbe94da11434194d5790fcd91005e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:27.746992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0cd25-5acd-4b15-a4f6-bc4468dd80e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:27.748483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0cd25-5acd-4b15-a4f6-bc4468dd80e6 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:27.795820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017dbe94da11434194d5790fcd91005e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:27.802560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 888/1792] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:27.840283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017dbe94da11434194d5790fcd91005e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:27.846174 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017dbe94da11434194d5790fcd91005e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:27.902901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 905/1793] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:27 2022] DELETE /identity/v3/users/017dbe94da11434194d5790fcd91005e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:28.227352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0cd25-5acd-4b15-a4f6-bc4468dd80e6 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:28.228953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dfd0cd25-5acd-4b15-a4f6-bc4468dd80e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:28.268439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0cd25-5acd-4b15-a4f6-bc4468dd80e6 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:28.461504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:28.463261 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:28.463749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:28.464232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] PATH_INFO: `/v3/projects/1e582f69e848445e803110627c3c8616` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:28.465718 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e582f69e848445e803110627c3c8616)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:28.467955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:28.635246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e582f69e848445e803110627c3c8616', 'request_id': 'req-7933743d-6d5e-4b56-973c-d40bd77e67e2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:28.670857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e582f69e848445e803110627c3c8616', 'request_id': 'req-7933743d-6d5e-4b56-973c-d40bd77e67e2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:28.696835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e582f69e848445e803110627c3c8616', 'request_id': 'req-7933743d-6d5e-4b56-973c-d40bd77e67e2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:28.740397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] The token cache is being invalidate because project 1e582f69e848445e803110627c3c8616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:28.743223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:28.749706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:28.762437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 889/1794] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:28 2022] DELETE /identity/v3/projects/1e582f69e848445e803110627c3c8616 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:28.766267 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:28.768567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:28.804090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99e214-e402-4f58-b619-d75bd1825ced admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:28.978000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:29.001316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:29.004844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:29.005741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:29.006962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] PATH_INFO: `/v3/users/fc0f7339f3d940538891555187fe34ac` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:29.011252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0f7339f3d940538891555187fe34ac)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:29.015866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:29.127725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0f7339f3d940538891555187fe34ac'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:29.128930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0f7339f3d940538891555187fe34ac'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:29.169444 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0f7339f3d940538891555187fe34ac'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:29.201570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0f7339f3d940538891555187fe34ac'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:29.202311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0f7339f3d940538891555187fe34ac'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:29.250532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 906/1795] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:28 2022] DELETE /identity/v3/users/fc0f7339f3d940538891555187fe34ac => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:29.355707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:29.357322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:29.521438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933743d-6d5e-4b56-973c-d40bd77e67e2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:29.544237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:29.663630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91443-c5d0-469d-a4d9-25016c83ab93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:29.664728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91443-c5d0-469d-a4d9-25016c83ab93 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:29.665241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91443-c5d0-469d-a4d9-25016c83ab93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:29.665659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91443-c5d0-469d-a4d9-25016c83ab93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:29.669613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-06c91443-c5d0-469d-a4d9-25016c83ab93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:29.977394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91443-c5d0-469d-a4d9-25016c83ab93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:30.017789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91443-c5d0-469d-a4d9-25016c83ab93 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:30.064762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 890/1796] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:30.409527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:30.413160 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:30.640018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045c8ad-de11-4fa6-b7ac-353db0e3d303 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:30.664134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:30.665792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:30.668066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:30.669706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] PATH_INFO: `/v3/projects/1614d4a1a30f49779e035d25905eaffd` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:30.674780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1614d4a1a30f49779e035d25905eaffd)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:30.681599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:30.816200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1614d4a1a30f49779e035d25905eaffd', 'request_id': 'req-c4558308-2343-4d7a-bb62-a4fb6028fe38'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:30.826486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1614d4a1a30f49779e035d25905eaffd', 'request_id': 'req-c4558308-2343-4d7a-bb62-a4fb6028fe38'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:30.839590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1614d4a1a30f49779e035d25905eaffd', 'request_id': 'req-c4558308-2343-4d7a-bb62-a4fb6028fe38'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:30.918290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] The token cache is being invalidate because project 1614d4a1a30f49779e035d25905eaffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:30.919646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:30.920799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4558308-2343-4d7a-bb62-a4fb6028fe38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:30.924276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 907/1797] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:30 2022] DELETE /identity/v3/projects/1614d4a1a30f49779e035d25905eaffd => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:30.930198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd752ae-8f2e-48d2-9d14-b8c44c26aa27 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:30.930805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd752ae-8f2e-48d2-9d14-b8c44c26aa27 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:30.930901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd752ae-8f2e-48d2-9d14-b8c44c26aa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.031640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dfd752ae-8f2e-48d2-9d14-b8c44c26aa27 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:31.036381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dfd752ae-8f2e-48d2-9d14-b8c44c26aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:31.120810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a03bb8-b49e-41ce-a305-37e87b970e45 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.121405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a03bb8-b49e-41ce-a305-37e87b970e45 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.123117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a03bb8-b49e-41ce-a305-37e87b970e45 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.125460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 908/1798] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:10:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 17:10:31.156824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280123-25e4-41b8-8643-e1483ba294bb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.157360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280123-25e4-41b8-8643-e1483ba294bb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.157852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280123-25e4-41b8-8643-e1483ba294bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.186576 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:31.230885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 891/1799] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:31.233414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e04afc-f76e-4521-a7cc-9ea11461c94c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.236118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e04afc-f76e-4521-a7cc-9ea11461c94c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.236564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e04afc-f76e-4521-a7cc-9ea11461c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.237193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bb280123-25e4-41b8-8643-e1483ba294bb None None] MFA Rules not processed for user `4716f9539151414dadd9e4b8f13ffc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:31.249703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bb280123-25e4-41b8-8643-e1483ba294bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:31.281528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-19e04afc-f76e-4521-a7cc-9ea11461c94c None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:31.304983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-19e04afc-f76e-4521-a7cc-9ea11461c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:31.345853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 892/1800] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:31.350476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e04afc-f76e-4521-a7cc-9ea11461c94c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:31.373445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e04afc-f76e-4521-a7cc-9ea11461c94c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:31.401707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87552b-244a-448d-ad67-1c2f3a370245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:31.402543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87552b-244a-448d-ad67-1c2f3a370245 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.403805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87552b-244a-448d-ad67-1c2f3a370245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.404370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87552b-244a-448d-ad67-1c2f3a370245 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.410021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87552b-244a-448d-ad67-1c2f3a370245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:31.410690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87552b-244a-448d-ad67-1c2f3a370245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:31.412765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87552b-244a-448d-ad67-1c2f3a370245 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:31.439624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 893/1801] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:31.443771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87552b-244a-448d-ad67-1c2f3a370245 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:31.461481 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87552b-244a-448d-ad67-1c2f3a370245 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:31.479538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fbd28-4fa8-4995-8190-ca007776555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:31.480467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fbd28-4fa8-4995-8190-ca007776555c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.480897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fbd28-4fa8-4995-8190-ca007776555c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.481343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fbd28-4fa8-4995-8190-ca007776555c admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.482141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fbd28-4fa8-4995-8190-ca007776555c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:31.484490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fbd28-4fa8-4995-8190-ca007776555c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:31.546026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 894/1802] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:31 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:31.547027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fbd28-4fa8-4995-8190-ca007776555c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:31.551234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 909/1803] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:10:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:31.601276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:31.651936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28772600-3880-49a8-af30-3db906e275b5 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.653004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28772600-3880-49a8-af30-3db906e275b5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.653637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28772600-3880-49a8-af30-3db906e275b5 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.657391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 910/1804] 10.222.0.76 () {54 vars in 961 bytes} [Mon Sep 19 17:10:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:10:31.672392 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59b63-5353-45ae-9455-329af555163e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.672392 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59b63-5353-45ae-9455-329af555163e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.672392 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b59b63-5353-45ae-9455-329af555163e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.680343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fbd28-4fa8-4995-8190-ca007776555c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:31.694015 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b03676-5b1b-44da-ae02-c561c6a0656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:31.694730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b03676-5b1b-44da-ae02-c561c6a0656d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.695013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b03676-5b1b-44da-ae02-c561c6a0656d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.699279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b03676-5b1b-44da-ae02-c561c6a0656d admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.699279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b03676-5b1b-44da-ae02-c561c6a0656d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:31.705158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b03676-5b1b-44da-ae02-c561c6a0656d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:31.753569 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 895/1805] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:31 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:31.755198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-45b59b63-5353-45ae-9455-329af555163e None None] MFA Rules not processed for user `4716f9539151414dadd9e4b8f13ffc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:31.758086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b03676-5b1b-44da-ae02-c561c6a0656d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:31.763425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-45b59b63-5353-45ae-9455-329af555163e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:31.774163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b03676-5b1b-44da-ae02-c561c6a0656d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:31.789902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe7338-a49c-410f-a0ab-dad92b250229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:31.790536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe7338-a49c-410f-a0ab-dad92b250229 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.790815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe7338-a49c-410f-a0ab-dad92b250229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.791087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe7338-a49c-410f-a0ab-dad92b250229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.791754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe7338-a49c-410f-a0ab-dad92b250229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:31.795719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe7338-a49c-410f-a0ab-dad92b250229 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:31.826387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 896/1806] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:31.827945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe7338-a49c-410f-a0ab-dad92b250229 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:31.848324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe7338-a49c-410f-a0ab-dad92b250229 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:31.859711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01780a74-e88e-47c9-96eb-fc043210d9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:31.862329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01780a74-e88e-47c9-96eb-fc043210d9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.862643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01780a74-e88e-47c9-96eb-fc043210d9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.862932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01780a74-e88e-47c9-96eb-fc043210d9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:31.863621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01780a74-e88e-47c9-96eb-fc043210d9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:31.865371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01780a74-e88e-47c9-96eb-fc043210d9a2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:31.896357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 897/1807] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:10:31.899793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01780a74-e88e-47c9-96eb-fc043210d9a2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:31.940128 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01780a74-e88e-47c9-96eb-fc043210d9a2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:31.982665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc13c8-5e80-4832-ba63-903726288c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:31.983346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc13c8-5e80-4832-ba63-903726288c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:31.983634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc13c8-5e80-4832-ba63-903726288c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:31.983912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc13c8-5e80-4832-ba63-903726288c98 admin admin] PATH_INFO: `/v3/projects/0cb58eb47bfd4af6a12fa3ce61451690/users/42fddd51b381411c9c09155502875388/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:32.044537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 911/1808] 10.222.0.76 () {58 vars in 1058 bytes} [Mon Sep 19 17:10:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:32.048334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc13c8-5e80-4832-ba63-903726288c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb58eb47bfd4af6a12fa3ce61451690, user_id=42fddd51b381411c9c09155502875388, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:32.054814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b59b63-5353-45ae-9455-329af555163e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:32.055224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc13c8-5e80-4832-ba63-903726288c98 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:32.100800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b59b63-5353-45ae-9455-329af555163e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:32.113465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 898/1809] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:31 2022] PUT /identity/v3/projects/0cb58eb47bfd4af6a12fa3ce61451690/users/42fddd51b381411c9c09155502875388/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:32.116845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc13c8-5e80-4832-ba63-903726288c98 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:32.123776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ccfc13c8-5e80-4832-ba63-903726288c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:32.276279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c412a0a-553d-4bdd-ac0e-1c8ce9f4e2df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4716f9539151414dadd9e4b8f13ffc0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:32.277077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c412a0a-553d-4bdd-ac0e-1c8ce9f4e2df service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:32.277369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c412a0a-553d-4bdd-ac0e-1c8ce9f4e2df service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:32.277644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c412a0a-553d-4bdd-ac0e-1c8ce9f4e2df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:32.299628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c412a0a-553d-4bdd-ac0e-1c8ce9f4e2df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:32.301754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c412a0a-553d-4bdd-ac0e-1c8ce9f4e2df service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:32.327666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 912/1810] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:32.337412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286926d-cc45-46ea-8317-3a30577ec988 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:32.337753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286926d-cc45-46ea-8317-3a30577ec988 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:32.338123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286926d-cc45-46ea-8317-3a30577ec988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:32.372922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc13c8-5e80-4832-ba63-903726288c98 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:32.392936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:32.397312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:32.398329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:32.399026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b286926d-cc45-46ea-8317-3a30577ec988 None None] MFA Rules not processed for user `42fddd51b381411c9c09155502875388`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:32.399607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] PATH_INFO: `/v3/users/471fe932ad8f4a2186da8f57d4237c9c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:32.400476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b286926d-cc45-46ea-8317-3a30577ec988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:32.404810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=471fe932ad8f4a2186da8f57d4237c9c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:32.417754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:32.445945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:32.607388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '471fe932ad8f4a2186da8f57d4237c9c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:32.629646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '471fe932ad8f4a2186da8f57d4237c9c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:32.632798 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '471fe932ad8f4a2186da8f57d4237c9c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:32.650756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 913/1811] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:32.652529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286926d-cc45-46ea-8317-3a30577ec988 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:32.657191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b286926d-cc45-46ea-8317-3a30577ec988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:32.663026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '471fe932ad8f4a2186da8f57d4237c9c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:32.664269 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '471fe932ad8f4a2186da8f57d4237c9c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:32.677862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:32.699850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286926d-cc45-46ea-8317-3a30577ec988 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:32.718669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:32.719079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 899/1812] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:32 2022] DELETE /identity/v3/users/471fe932ad8f4a2186da8f57d4237c9c => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:32.719344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:32.719630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:32.719985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] PATH_INFO: `/v3/projects/d60a55aee02a4866b8312e456f69fc65` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:32.720076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:32.722533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60a55aee02a4866b8312e456f69fc65)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:32.724535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:32.724791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:32.858679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60a55aee02a4866b8312e456f69fc65', 'request_id': 'req-9d8d164b-1f55-470b-950d-867f17a12c62'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:32.875097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60a55aee02a4866b8312e456f69fc65', 'request_id': 'req-9d8d164b-1f55-470b-950d-867f17a12c62'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:32.891284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60a55aee02a4866b8312e456f69fc65', 'request_id': 'req-9d8d164b-1f55-470b-950d-867f17a12c62'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:32.915346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecba65-e694-485a-b20f-ebfd6743cfbe admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:32.923962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] The token cache is being invalidate because project d60a55aee02a4866b8312e456f69fc65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:32.925447 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:32.929611 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9d8d164b-1f55-470b-950d-867f17a12c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:32.934155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 914/1813] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:32 2022] DELETE /identity/v3/projects/d60a55aee02a4866b8312e456f69fc65 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:32.936071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63e84-6aef-4c9c-b4e7-fa491222024e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:32.937734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63e84-6aef-4c9c-b4e7-fa491222024e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:32.940876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade63e84-6aef-4c9c-b4e7-fa491222024e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:32.980765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ade63e84-6aef-4c9c-b4e7-fa491222024e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:32.982308 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ade63e84-6aef-4c9c-b4e7-fa491222024e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:33.063506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d96b2-7cdb-4839-892d-be7abc4c66b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:33.064618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d96b2-7cdb-4839-892d-be7abc4c66b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:33.064839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d96b2-7cdb-4839-892d-be7abc4c66b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:33.065218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d96b2-7cdb-4839-892d-be7abc4c66b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:33.068759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-878d96b2-7cdb-4839-892d-be7abc4c66b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:33.146766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 915/1814] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:33.148319 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896fd33-99c7-4a6e-8eae-d693247d6380 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:33.154784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896fd33-99c7-4a6e-8eae-d693247d6380 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:33.155221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896fd33-99c7-4a6e-8eae-d693247d6380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:33.196785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9896fd33-99c7-4a6e-8eae-d693247d6380 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:33.198330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9896fd33-99c7-4a6e-8eae-d693247d6380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:33.220305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d96b2-7cdb-4839-892d-be7abc4c66b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:33.222073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 916/1815] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:33.223128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896fd33-99c7-4a6e-8eae-d693247d6380 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:33.223928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d96b2-7cdb-4839-892d-be7abc4c66b5 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:33.224687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9896fd33-99c7-4a6e-8eae-d693247d6380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:33.240437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 900/1816] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:33.242244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ed2ec-3b6e-4f9c-81ef-2b6bbcb8d489 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:33.243369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ed2ec-3b6e-4f9c-81ef-2b6bbcb8d489 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:33.243960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ed2ec-3b6e-4f9c-81ef-2b6bbcb8d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:33.291153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bc8ed2ec-3b6e-4f9c-81ef-2b6bbcb8d489 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:33.293185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bc8ed2ec-3b6e-4f9c-81ef-2b6bbcb8d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:33.309277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 901/1817] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:33.310665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ed2ec-3b6e-4f9c-81ef-2b6bbcb8d489 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:33.312558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bc8ed2ec-3b6e-4f9c-81ef-2b6bbcb8d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:33.314548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:33.352094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ed2ec-3b6e-4f9c-81ef-2b6bbcb8d489 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:33.359506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:33.360204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:33.360483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:33.360762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] PATH_INFO: `/v3/users/42fddd51b381411c9c09155502875388` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:33.361971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42fddd51b381411c9c09155502875388)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:33.367279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:33.370499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896fd33-99c7-4a6e-8eae-d693247d6380 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:33.382388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfef29e-a19f-4a2e-9a55-c35e843dfeac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:33.383227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef29e-a19f-4a2e-9a55-c35e843dfeac service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:33.383675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef29e-a19f-4a2e-9a55-c35e843dfeac service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:33.384065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfef29e-a19f-4a2e-9a55-c35e843dfeac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:33.406521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfef29e-a19f-4a2e-9a55-c35e843dfeac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:33.408366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfef29e-a19f-4a2e-9a55-c35e843dfeac service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:33.435471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 917/1818] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:33.437735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfef29e-a19f-4a2e-9a55-c35e843dfeac service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:33.480921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfef29e-a19f-4a2e-9a55-c35e843dfeac service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:33.482284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=8,keystone:SELECT=92 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:33.490287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42fddd51b381411c9c09155502875388'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:33.492477 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb3f21-9b11-4813-9bf9-c5085b3ec991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:33.493477 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb3f21-9b11-4813-9bf9-c5085b3ec991 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:33.493867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb3f21-9b11-4813-9bf9-c5085b3ec991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:33.494147 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb3f21-9b11-4813-9bf9-c5085b3ec991 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:33.494976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb3f21-9b11-4813-9bf9-c5085b3ec991 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:33.495598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb3f21-9b11-4813-9bf9-c5085b3ec991 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:33.500332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb3f21-9b11-4813-9bf9-c5085b3ec991 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:33.519280 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42fddd51b381411c9c09155502875388'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:33.520304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42fddd51b381411c9c09155502875388'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:33.540396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42fddd51b381411c9c09155502875388'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:33.542326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fcaad00d-eabd-45f0-b130-5630aa861350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42fddd51b381411c9c09155502875388'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:33.542456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 918/1819] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:33.544050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb3f21-9b11-4813-9bf9-c5085b3ec991 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:33.545917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5ceb3f21-9b11-4813-9bf9-c5085b3ec991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:33.567650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb3f21-9b11-4813-9bf9-c5085b3ec991 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:33.577425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef44fb-340e-4e5e-9629-fc9942684707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:33.579489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef44fb-340e-4e5e-9629-fc9942684707 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:33.580319 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef44fb-340e-4e5e-9629-fc9942684707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:33.580601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef44fb-340e-4e5e-9629-fc9942684707 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:33.600178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef44fb-340e-4e5e-9629-fc9942684707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:33.608263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef44fb-340e-4e5e-9629-fc9942684707 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:33.630405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 902/1820] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:33 2022] DELETE /identity/v3/users/42fddd51b381411c9c09155502875388 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:33.647647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dac2d0-71b5-4d95-a6c7-8d105b1e82b6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:33.647846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dac2d0-71b5-4d95-a6c7-8d105b1e82b6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:33.648118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dac2d0-71b5-4d95-a6c7-8d105b1e82b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:33.691818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 919/1821] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:33 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:33.694176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef44fb-340e-4e5e-9629-fc9942684707 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:33.749553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c4dac2d0-71b5-4d95-a6c7-8d105b1e82b6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:33.759741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c4dac2d0-71b5-4d95-a6c7-8d105b1e82b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:33.863077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef44fb-340e-4e5e-9629-fc9942684707 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:33.877063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa20f56-7f90-4144-bde9-7c49c04c855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:33.878955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa20f56-7f90-4144-bde9-7c49c04c855c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:33.879333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa20f56-7f90-4144-bde9-7c49c04c855c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:33.879614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa20f56-7f90-4144-bde9-7c49c04c855c admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:33.883646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa20f56-7f90-4144-bde9-7c49c04c855c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:33.888712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa20f56-7f90-4144-bde9-7c49c04c855c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:33.942807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 920/1822] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:33 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:33.956415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1629a-378f-4d90-85a8-ec0c2d6241cc None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:33.956763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1629a-378f-4d90-85a8-ec0c2d6241cc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:33.958984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1629a-378f-4d90-85a8-ec0c2d6241cc None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:33.965093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 921/1823] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:10:33 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:10:33.966204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1629a-378f-4d90-85a8-ec0c2d6241cc None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:34.023267 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1629a-378f-4d90-85a8-ec0c2d6241cc None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:34.034838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f4e93-9fb9-4f07-9d52-e3046cbcce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:34.036010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f4e93-9fb9-4f07-9d52-e3046cbcce60 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:34.036281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f4e93-9fb9-4f07-9d52-e3046cbcce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:34.036557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f4e93-9fb9-4f07-9d52-e3046cbcce60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:34.037529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f4e93-9fb9-4f07-9d52-e3046cbcce60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:34.039146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f4e93-9fb9-4f07-9d52-e3046cbcce60 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:34.061482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 903/1824] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:34.087294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 922/1825] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:34.089183 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dac2d0-71b5-4d95-a6c7-8d105b1e82b6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:34.112092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dac2d0-71b5-4d95-a6c7-8d105b1e82b6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:34.121848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4b265-9bcf-4391-b5ef-6abdd0040fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:34.122701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4b265-9bcf-4391-b5ef-6abdd0040fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:34.123084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4b265-9bcf-4391-b5ef-6abdd0040fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:34.123521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4b265-9bcf-4391-b5ef-6abdd0040fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:34.124359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4b265-9bcf-4391-b5ef-6abdd0040fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:34.126470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4b265-9bcf-4391-b5ef-6abdd0040fa5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:34.134988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a3709-f924-499d-b395-e6be7ad58141 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:34.135572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a3709-f924-499d-b395-e6be7ad58141 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:34.136028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a3709-f924-499d-b395-e6be7ad58141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:34.172279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 904/1826] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:34.173355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4b265-9bcf-4391-b5ef-6abdd0040fa5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:34.182867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cfe4b265-9bcf-4391-b5ef-6abdd0040fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:34.193120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-215a3709-f924-499d-b395-e6be7ad58141 None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:34.195161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-215a3709-f924-499d-b395-e6be7ad58141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:34.358358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4b265-9bcf-4391-b5ef-6abdd0040fa5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:34.367176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb8b40-2cf3-4ac0-a029-99262ab1ce93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:34.369557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb8b40-2cf3-4ac0-a029-99262ab1ce93 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:34.370052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb8b40-2cf3-4ac0-a029-99262ab1ce93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:34.371137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb8b40-2cf3-4ac0-a029-99262ab1ce93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:34.404766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 923/1827] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:34.405783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a3709-f924-499d-b395-e6be7ad58141 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:34.410253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb8b40-2cf3-4ac0-a029-99262ab1ce93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:34.413368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb8b40-2cf3-4ac0-a029-99262ab1ce93 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:34.428997 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a3709-f924-499d-b395-e6be7ad58141 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:34.452482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 905/1828] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:34.455339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fad177-cae6-4e27-9077-425fefc498e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:34.456115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad177-cae6-4e27-9077-425fefc498e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:34.456473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad177-cae6-4e27-9077-425fefc498e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:34.456813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad177-cae6-4e27-9077-425fefc498e0 admin admin] PATH_INFO: `/v3/projects/0dd17b9bbb824cdb95d3660650d5edc7/users/20da4e1c96724cc09cce61f5dd2a254c/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:34.467809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:34.493759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fad177-cae6-4e27-9077-425fefc498e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd17b9bbb824cdb95d3660650d5edc7, user_id=20da4e1c96724cc09cce61f5dd2a254c, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:34.497736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fad177-cae6-4e27-9077-425fefc498e0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:34.523172 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 924/1829] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:34 2022] PUT /identity/v3/projects/0dd17b9bbb824cdb95d3660650d5edc7/users/20da4e1c96724cc09cce61f5dd2a254c/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:34.537898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cf4c1-b6d8-4a4e-a63c-12c5b13e532f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:34.537898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cf4c1-b6d8-4a4e-a63c-12c5b13e532f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:34.537898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cf4c1-b6d8-4a4e-a63c-12c5b13e532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:34.575067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a82cf4c1-b6d8-4a4e-a63c-12c5b13e532f None None] MFA Rules not processed for user `20da4e1c96724cc09cce61f5dd2a254c`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:34.576358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a82cf4c1-b6d8-4a4e-a63c-12c5b13e532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:34.639491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:34.690843 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fad177-cae6-4e27-9077-425fefc498e0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:34.692705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6fad177-cae6-4e27-9077-425fefc498e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:34.707318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 906/1830] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:34.711555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cf4c1-b6d8-4a4e-a63c-12c5b13e532f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:34.909872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cf4c1-b6d8-4a4e-a63c-12c5b13e532f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:34.914954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fad177-cae6-4e27-9077-425fefc498e0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:34.928576 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf29a80-fa9a-4a5b-a02d-039de1cd3c14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:34.929539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf29a80-fa9a-4a5b-a02d-039de1cd3c14 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:34.930041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf29a80-fa9a-4a5b-a02d-039de1cd3c14 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:34.930602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf29a80-fa9a-4a5b-a02d-039de1cd3c14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:34.930714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6f12b-c659-48c0-bb56-8208e1a1f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:34.931319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6f12b-c659-48c0-bb56-8208e1a1f265 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:34.931596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6f12b-c659-48c0-bb56-8208e1a1f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:34.931864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6f12b-c659-48c0-bb56-8208e1a1f265 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:34.932519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6f12b-c659-48c0-bb56-8208e1a1f265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:34.940543 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6f12b-c659-48c0-bb56-8208e1a1f265 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:34.944474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf29a80-fa9a-4a5b-a02d-039de1cd3c14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:34.947496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf29a80-fa9a-4a5b-a02d-039de1cd3c14 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:34.988841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 925/1831] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:35.024117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 907/1832] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:34 2022] POST /identity/v3/projects => generated 387 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:35.027895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf29a80-fa9a-4a5b-a02d-039de1cd3c14 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:35.047011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf29a80-fa9a-4a5b-a02d-039de1cd3c14 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:35.099007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6f12b-c659-48c0-bb56-8208e1a1f265 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:35.102581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b8c6f12b-c659-48c0-bb56-8208e1a1f265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:35.181847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551a67a-8d6d-4230-8e7c-90a3300181b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:35.182863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551a67a-8d6d-4230-8e7c-90a3300181b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:35.183249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551a67a-8d6d-4230-8e7c-90a3300181b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:35.183878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551a67a-8d6d-4230-8e7c-90a3300181b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:35.185062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551a67a-8d6d-4230-8e7c-90a3300181b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:35.189136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551a67a-8d6d-4230-8e7c-90a3300181b5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:35.258914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 926/1833] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:35 2022] POST /identity/v3/users => generated 300 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:35.264852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e67e0e-c1d0-43de-b7e0-9cb05fc2ac4a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:35.265227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e67e0e-c1d0-43de-b7e0-9cb05fc2ac4a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:35.266775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e67e0e-c1d0-43de-b7e0-9cb05fc2ac4a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:35.274078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 927/1834] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:10:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:10:35.278286 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e67e0e-c1d0-43de-b7e0-9cb05fc2ac4a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:35.316550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6f12b-c659-48c0-bb56-8208e1a1f265 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:35.342235 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:35.343087 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e67e0e-c1d0-43de-b7e0-9cb05fc2ac4a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:35.343567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:35.344050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:35.344753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] PATH_INFO: `/v3/projects/fd266d6bb3f2400fb2f3b07ae85f9e14` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:35.346439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd266d6bb3f2400fb2f3b07ae85f9e14)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:35.351320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:35.355556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06304f-0ed5-493a-9836-a56672568184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:35.357995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06304f-0ed5-493a-9836-a56672568184 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:35.358532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06304f-0ed5-493a-9836-a56672568184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:35.359823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06304f-0ed5-493a-9836-a56672568184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:35.362553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06304f-0ed5-493a-9836-a56672568184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:35.365725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06304f-0ed5-493a-9836-a56672568184 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:35.418157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 928/1835] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:35.418157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd79700-7de2-4e57-82af-38ef23119627 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:35.418157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd79700-7de2-4e57-82af-38ef23119627 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:35.418521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd79700-7de2-4e57-82af-38ef23119627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:35.455402 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dcd79700-7de2-4e57-82af-38ef23119627 None None] MFA Rules not processed for user `4716f9539151414dadd9e4b8f13ffc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:35.457523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dcd79700-7de2-4e57-82af-38ef23119627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:35.468558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd266d6bb3f2400fb2f3b07ae85f9e14', 'request_id': 'req-80fc6721-63a1-49a7-9d99-a240f134b3ef'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:35.477945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd266d6bb3f2400fb2f3b07ae85f9e14', 'request_id': 'req-80fc6721-63a1-49a7-9d99-a240f134b3ef'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:35.491677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd266d6bb3f2400fb2f3b07ae85f9e14', 'request_id': 'req-80fc6721-63a1-49a7-9d99-a240f134b3ef'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:35.500370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:35.510282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] The token cache is being invalidate because project fd266d6bb3f2400fb2f3b07ae85f9e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:35.510562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:35.513083 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:35.515085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 908/1836] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:35 2022] DELETE /identity/v3/projects/fd266d6bb3f2400fb2f3b07ae85f9e14 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:35.521070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:35.533102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:35.576748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:35.639018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 929/1837] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:10:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:35.640094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd79700-7de2-4e57-82af-38ef23119627 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:35.641840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dcd79700-7de2-4e57-82af-38ef23119627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:35.684794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc6721-63a1-49a7-9d99-a240f134b3ef admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:35.694558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21974c3e-c007-48fd-be90-13d51d900dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:35.695301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21974c3e-c007-48fd-be90-13d51d900dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:35.695519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21974c3e-c007-48fd-be90-13d51d900dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:35.695893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21974c3e-c007-48fd-be90-13d51d900dc2 admin admin] PATH_INFO: `/v3/projects/9b17120a71334aaa8251a51ee536cca3/users/b3f6ad2eb4f0468cb68c775c7929f46a/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:35.730723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21974c3e-c007-48fd-be90-13d51d900dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b17120a71334aaa8251a51ee536cca3, user_id=b3f6ad2eb4f0468cb68c775c7929f46a, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:35.734137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21974c3e-c007-48fd-be90-13d51d900dc2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:35.771148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 909/1838] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:35 2022] PUT /identity/v3/projects/9b17120a71334aaa8251a51ee536cca3/users/b3f6ad2eb4f0468cb68c775c7929f46a/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:35.772110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21974c3e-c007-48fd-be90-13d51d900dc2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:35.774990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-21974c3e-c007-48fd-be90-13d51d900dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:35.808425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd79700-7de2-4e57-82af-38ef23119627 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:35.924566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:35.925468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:35.925810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:35.926625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] PATH_INFO: `/v3/users/cbda4797c0f44f3980dd35b758fc767b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:35.929578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbda4797c0f44f3980dd35b758fc767b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:35.932324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:35.939642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21974c3e-c007-48fd-be90-13d51d900dc2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:35.945019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:35.946675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:35.946954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:35.947222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] PATH_INFO: `/v3/users/0a5fd2b4e85d465f95ed60d33a63946c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:35.948457 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5fd2b4e85d465f95ed60d33a63946c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:35.950371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:36.042309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbda4797c0f44f3980dd35b758fc767b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.047080 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbda4797c0f44f3980dd35b758fc767b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.081599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5fd2b4e85d465f95ed60d33a63946c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.085531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbda4797c0f44f3980dd35b758fc767b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.105263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5fd2b4e85d465f95ed60d33a63946c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.107329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5fd2b4e85d465f95ed60d33a63946c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.108401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbda4797c0f44f3980dd35b758fc767b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.109507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbda4797c0f44f3980dd35b758fc767b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.140493 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5fd2b4e85d465f95ed60d33a63946c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.141491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5fd2b4e85d465f95ed60d33a63946c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.155776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 930/1839] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:35 2022] DELETE /identity/v3/users/cbda4797c0f44f3980dd35b758fc767b => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:36.156888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:36.161452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:36.176077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:36.191635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 910/1840] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:35 2022] DELETE /identity/v3/users/0a5fd2b4e85d465f95ed60d33a63946c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:36.192998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:36.196246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:36.196720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:36.346347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd0b01-7d3e-46af-adb3-02936bb18c3e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:36.404876 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb3ed9-1458-4823-b066-bb5722023b04 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:36.430045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:36.430764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:36.431054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:36.431325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] PATH_INFO: `/v3/projects/0cb58eb47bfd4af6a12fa3ce61451690` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:36.433694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb58eb47bfd4af6a12fa3ce61451690)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:36.435736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:36.558423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:36.561540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:36.561847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:36.562130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] PATH_INFO: `/v3/users/7ec24d5d0eb041e79b9d9ffa7be8c3ff` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:36.570950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec24d5d0eb041e79b9d9ffa7be8c3ff)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:36.577072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:36.660868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb58eb47bfd4af6a12fa3ce61451690', 'request_id': 'req-5185363a-92fb-4098-93cc-61409122831b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.671511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb58eb47bfd4af6a12fa3ce61451690', 'request_id': 'req-5185363a-92fb-4098-93cc-61409122831b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.692698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb58eb47bfd4af6a12fa3ce61451690', 'request_id': 'req-5185363a-92fb-4098-93cc-61409122831b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.712193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] The token cache is being invalidate because project 0cb58eb47bfd4af6a12fa3ce61451690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:36.713182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.714988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.719154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 911/1841] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:36 2022] DELETE /identity/v3/projects/0cb58eb47bfd4af6a12fa3ce61451690 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:36.722763 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:36.724490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:36.758283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec24d5d0eb041e79b9d9ffa7be8c3ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.764880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec24d5d0eb041e79b9d9ffa7be8c3ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.802237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec24d5d0eb041e79b9d9ffa7be8c3ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.819356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec24d5d0eb041e79b9d9ffa7be8c3ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.820380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec24d5d0eb041e79b9d9ffa7be8c3ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:36.872445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 931/1842] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:36 2022] DELETE /identity/v3/users/7ec24d5d0eb041e79b9d9ffa7be8c3ff => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:36.874941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:36.878984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:36.906848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185363a-92fb-4098-93cc-61409122831b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:36.985857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:37.053128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:37.055677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882db876-3dde-4b52-95bc-1208cffd009e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4716f9539151414dadd9e4b8f13ffc0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:37.058866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882db876-3dde-4b52-95bc-1208cffd009e service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.059784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882db876-3dde-4b52-95bc-1208cffd009e service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.059784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882db876-3dde-4b52-95bc-1208cffd009e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.063963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-882db876-3dde-4b52-95bc-1208cffd009e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:37.100723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882db876-3dde-4b52-95bc-1208cffd009e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:37.110169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882db876-3dde-4b52-95bc-1208cffd009e service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:37.120331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad5a04-dfff-4444-96a1-4d562f4ccbfa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:37.132677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919058-4e12-4673-a1fd-c6d8ab9c51a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:37.135150 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919058-4e12-4673-a1fd-c6d8ab9c51a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.135458 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919058-4e12-4673-a1fd-c6d8ab9c51a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.135725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919058-4e12-4673-a1fd-c6d8ab9c51a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.136642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 912/1843] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:37.145832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2919058-4e12-4673-a1fd-c6d8ab9c51a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:37.150235 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bcc8f-35d0-4e81-92d0-03b4513c5665 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.150510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bcc8f-35d0-4e81-92d0-03b4513c5665 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.150788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bcc8f-35d0-4e81-92d0-03b4513c5665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.153232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2919058-4e12-4673-a1fd-c6d8ab9c51a3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:37.176438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 932/1844] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:37.181905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f33c5-4bd0-4813-9b2e-7fcf52eedc0e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.182205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f33c5-4bd0-4813-9b2e-7fcf52eedc0e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.182459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f33c5-4bd0-4813-9b2e-7fcf52eedc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.196300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-537bcc8f-35d0-4e81-92d0-03b4513c5665 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:37.199182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-537bcc8f-35d0-4e81-92d0-03b4513c5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:37.220172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 913/1845] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:37.224535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bcc8f-35d0-4e81-92d0-03b4513c5665 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:37.232643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4c1f33c5-4bd0-4813-9b2e-7fcf52eedc0e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:37.234230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4c1f33c5-4bd0-4813-9b2e-7fcf52eedc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:37.245611 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bcc8f-35d0-4e81-92d0-03b4513c5665 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:37.260378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 933/1846] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:37.260378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766ac29-cfc2-411a-a508-13c9c8904d78 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.260378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766ac29-cfc2-411a-a508-13c9c8904d78 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.260378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766ac29-cfc2-411a-a508-13c9c8904d78 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.260378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 934/1847] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:10:37.262872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d197d-37f5-4e2d-bc48-691de0da9ec7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.263142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d197d-37f5-4e2d-bc48-691de0da9ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.263416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d197d-37f5-4e2d-bc48-691de0da9ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.265723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483ca71-3eaa-4525-adba-1942d5311075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:37.266421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483ca71-3eaa-4525-adba-1942d5311075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.266702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483ca71-3eaa-4525-adba-1942d5311075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.266973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483ca71-3eaa-4525-adba-1942d5311075 admin admin] PATH_INFO: `/v3/projects/9b17120a71334aaa8251a51ee536cca3/users/b3f6ad2eb4f0468cb68c775c7929f46a/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.269917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483ca71-3eaa-4525-adba-1942d5311075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b17120a71334aaa8251a51ee536cca3, user_id=b3f6ad2eb4f0468cb68c775c7929f46a, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:37.274098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483ca71-3eaa-4525-adba-1942d5311075 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:37.306495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 914/1848] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:37 2022] PUT /identity/v3/projects/9b17120a71334aaa8251a51ee536cca3/users/b3f6ad2eb4f0468cb68c775c7929f46a/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:37.322302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99efa58-dadf-4eba-bb2d-53e1a9eb614a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.322601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99efa58-dadf-4eba-bb2d-53e1a9eb614a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.322861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99efa58-dadf-4eba-bb2d-53e1a9eb614a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.330647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d76d197d-37f5-4e2d-bc48-691de0da9ec7 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:37.333212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d76d197d-37f5-4e2d-bc48-691de0da9ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:37.355077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d99efa58-dadf-4eba-bb2d-53e1a9eb614a None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:37.357027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d99efa58-dadf-4eba-bb2d-53e1a9eb614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:37.567541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 915/1849] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:37.570746 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 935/1850] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:37.571776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec373b5-5762-4253-8165-000668aba144 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.571988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d197d-37f5-4e2d-bc48-691de0da9ec7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:37.572089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec373b5-5762-4253-8165-000668aba144 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.572361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec373b5-5762-4253-8165-000668aba144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.575187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d76d197d-37f5-4e2d-bc48-691de0da9ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:37.657318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bec373b5-5762-4253-8165-000668aba144 None None] MFA Rules not processed for user `b3f6ad2eb4f0468cb68c775c7929f46a`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:37.659946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bec373b5-5762-4253-8165-000668aba144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:37.688480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d197d-37f5-4e2d-bc48-691de0da9ec7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:37.704612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fa666-25bc-4a11-ad84-275983cd5fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:37.705552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fa666-25bc-4a11-ad84-275983cd5fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.705838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fa666-25bc-4a11-ad84-275983cd5fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.706118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fa666-25bc-4a11-ad84-275983cd5fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.739926 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fa666-25bc-4a11-ad84-275983cd5fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:37.742790 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fa666-25bc-4a11-ad84-275983cd5fc7 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:37.778072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 936/1851] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:37.779018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fa666-25bc-4a11-ad84-275983cd5fc7 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:37.797249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fa666-25bc-4a11-ad84-275983cd5fc7 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:37.807390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc2308-a4fa-42c0-acad-2fabd268c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:37.808093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc2308-a4fa-42c0-acad-2fabd268c4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.808376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc2308-a4fa-42c0-acad-2fabd268c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.808779 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc2308-a4fa-42c0-acad-2fabd268c4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.809428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc2308-a4fa-42c0-acad-2fabd268c4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:37.817118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc2308-a4fa-42c0-acad-2fabd268c4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:37.817118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc2308-a4fa-42c0-acad-2fabd268c4ba admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:37.846086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 937/1852] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:37.850307 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc2308-a4fa-42c0-acad-2fabd268c4ba admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:37.868413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc2308-a4fa-42c0-acad-2fabd268c4ba admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:37.882138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85d3d0-4e5c-4fd8-970b-679bdaf1aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:37.882797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85d3d0-4e5c-4fd8-970b-679bdaf1aa64 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:37.883148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85d3d0-4e5c-4fd8-970b-679bdaf1aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:37.883431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85d3d0-4e5c-4fd8-970b-679bdaf1aa64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:37.884097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85d3d0-4e5c-4fd8-970b-679bdaf1aa64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:37.886653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85d3d0-4e5c-4fd8-970b-679bdaf1aa64 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:37.886973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 916/1853] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:37.888023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec373b5-5762-4253-8165-000668aba144 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:37.899955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bec373b5-5762-4253-8165-000668aba144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:37.932873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 938/1854] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:37 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:37.932873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85d3d0-4e5c-4fd8-970b-679bdaf1aa64 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:37.933971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8e85d3d0-4e5c-4fd8-970b-679bdaf1aa64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:37.942221 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec373b5-5762-4253-8165-000668aba144 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:37.980905 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:38.058676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:38.097736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85d3d0-4e5c-4fd8-970b-679bdaf1aa64 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:38.105101 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:38.106591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:38.107146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:38.107628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] PATH_INFO: `/v3/projects/1e0c7a247cd74f60be253d23c46bd6e7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:38.109267 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0c7a247cd74f60be253d23c46bd6e7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:38.112182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:38.179214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756633e4-49ae-4876-bf52-50aca0fab818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:38.179857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756633e4-49ae-4876-bf52-50aca0fab818 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:38.181437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756633e4-49ae-4876-bf52-50aca0fab818 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:38.182223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756633e4-49ae-4876-bf52-50aca0fab818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:38.211600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756633e4-49ae-4876-bf52-50aca0fab818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:38.213232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0c7a247cd74f60be253d23c46bd6e7', 'request_id': 'req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:38.217011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756633e4-49ae-4876-bf52-50aca0fab818 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:38.222472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0c7a247cd74f60be253d23c46bd6e7', 'request_id': 'req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:38.236734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0c7a247cd74f60be253d23c46bd6e7', 'request_id': 'req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:38.258114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] The token cache is being invalidate because project 1e0c7a247cd74f60be253d23c46bd6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:38.258933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:38.260072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:38.267529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 939/1855] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:37 2022] DELETE /identity/v3/projects/1e0c7a247cd74f60be253d23c46bd6e7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:38.269140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:38.271564 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:38.285157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 917/1856] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:38.287778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756633e4-49ae-4876-bf52-50aca0fab818 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:38.326575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756633e4-49ae-4876-bf52-50aca0fab818 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:38.458181 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715be838-be7b-4fd5-b50f-266f9c785a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:38.460271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715be838-be7b-4fd5-b50f-266f9c785a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:38.461485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715be838-be7b-4fd5-b50f-266f9c785a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:38.463225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715be838-be7b-4fd5-b50f-266f9c785a7c admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:38.465694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715be838-be7b-4fd5-b50f-266f9c785a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:38.471119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715be838-be7b-4fd5-b50f-266f9c785a7c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:38.510984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae4d15-b264-4eb5-be12-5e94ee16ed9f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:38.521741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 918/1857] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:38 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:38.523348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d963bc-5129-48d1-84d6-b50c92170eba None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:38.523641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d963bc-5129-48d1-84d6-b50c92170eba None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:38.523919 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d963bc-5129-48d1-84d6-b50c92170eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:38.525509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36a5d3-ee50-4a14-ac15-a36b37dd08fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:38.526350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36a5d3-ee50-4a14-ac15-a36b37dd08fd service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:38.526644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36a5d3-ee50-4a14-ac15-a36b37dd08fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:38.527037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36a5d3-ee50-4a14-ac15-a36b37dd08fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:38.528989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6f36a5d3-ee50-4a14-ac15-a36b37dd08fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:38.561437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-13d963bc-5129-48d1-84d6-b50c92170eba None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:38.563945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-13d963bc-5129-48d1-84d6-b50c92170eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:38.582791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 919/1858] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:38.583938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d963bc-5129-48d1-84d6-b50c92170eba None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:38.585298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-13d963bc-5129-48d1-84d6-b50c92170eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:38.609648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d963bc-5129-48d1-84d6-b50c92170eba None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:38.626564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:38.629793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:38.630791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:38.631477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] PATH_INFO: `/v3/projects/18f4e92be6674e9bafe7ff815253dce7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:38.638457 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f4e92be6674e9bafe7ff815253dce7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:38.644267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:38.706867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36a5d3-ee50-4a14-ac15-a36b37dd08fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:38.708488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36a5d3-ee50-4a14-ac15-a36b37dd08fd service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:38.722139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 940/1859] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:38.723152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36a5d3-ee50-4a14-ac15-a36b37dd08fd service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:38.724784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6f36a5d3-ee50-4a14-ac15-a36b37dd08fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:38.742187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36a5d3-ee50-4a14-ac15-a36b37dd08fd service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:38.794555 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:38.794727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f4e92be6674e9bafe7ff815253dce7', 'request_id': 'req-92136976-f79e-4e58-a95e-192131fce9d7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:38.809416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f4e92be6674e9bafe7ff815253dce7', 'request_id': 'req-92136976-f79e-4e58-a95e-192131fce9d7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:38.849131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f4e92be6674e9bafe7ff815253dce7', 'request_id': 'req-92136976-f79e-4e58-a95e-192131fce9d7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:38.889059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] The token cache is being invalidate because project 18f4e92be6674e9bafe7ff815253dce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:38.889059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:38.889059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-92136976-f79e-4e58-a95e-192131fce9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:38.894885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 920/1860] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:38 2022] DELETE /identity/v3/projects/18f4e92be6674e9bafe7ff815253dce7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:38.898526 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0b68b-3afb-440f-96bb-6af32c8d5dbd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:38.899092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0b68b-3afb-440f-96bb-6af32c8d5dbd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:38.899092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0b68b-3afb-440f-96bb-6af32c8d5dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:38.906751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610e1ed-0a1a-4d87-bc7b-8d1d07591054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:38.907541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e1ed-0a1a-4d87-bc7b-8d1d07591054 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:38.907895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e1ed-0a1a-4d87-bc7b-8d1d07591054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:38.908365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610e1ed-0a1a-4d87-bc7b-8d1d07591054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:38.909072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610e1ed-0a1a-4d87-bc7b-8d1d07591054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:38.911413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610e1ed-0a1a-4d87-bc7b-8d1d07591054 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:38.929216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 941/1861] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:38.932226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610e1ed-0a1a-4d87-bc7b-8d1d07591054 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:38.933140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dae0b68b-3afb-440f-96bb-6af32c8d5dbd None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:38.934925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dae0b68b-3afb-440f-96bb-6af32c8d5dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:38.942371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3610e1ed-0a1a-4d87-bc7b-8d1d07591054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:38.944562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 921/1862] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:38.945380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0b68b-3afb-440f-96bb-6af32c8d5dbd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:38.946712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dae0b68b-3afb-440f-96bb-6af32c8d5dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:38.955187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:38.961500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610e1ed-0a1a-4d87-bc7b-8d1d07591054 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:38.961670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0b68b-3afb-440f-96bb-6af32c8d5dbd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:38.967876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:38.968446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169db8e9-264f-4a80-8d7a-ba291063370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:38.968954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:38.969340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:38.969592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169db8e9-264f-4a80-8d7a-ba291063370c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:38.969695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] PATH_INFO: `/v3/users/e9ee8811051e42fda58065defb57fc20` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:38.970628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169db8e9-264f-4a80-8d7a-ba291063370c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:38.970628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169db8e9-264f-4a80-8d7a-ba291063370c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:38.971207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ee8811051e42fda58065defb57fc20)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:38.971464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169db8e9-264f-4a80-8d7a-ba291063370c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:38.974003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:38.974667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169db8e9-264f-4a80-8d7a-ba291063370c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:38.993909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 922/1863] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:38.995662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169db8e9-264f-4a80-8d7a-ba291063370c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:39.013134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169db8e9-264f-4a80-8d7a-ba291063370c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:39.020462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5cc58-5cf3-4a6d-bde9-0ba52c339067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:39.021269 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5cc58-5cf3-4a6d-bde9-0ba52c339067 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:39.021590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5cc58-5cf3-4a6d-bde9-0ba52c339067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:39.022508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5cc58-5cf3-4a6d-bde9-0ba52c339067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:39.022922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5cc58-5cf3-4a6d-bde9-0ba52c339067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:39.023105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5cc58-5cf3-4a6d-bde9-0ba52c339067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:39.025541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5cc58-5cf3-4a6d-bde9-0ba52c339067 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:39.042376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 923/1864] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:39.043246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5cc58-5cf3-4a6d-bde9-0ba52c339067 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:39.056104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5cc58-5cf3-4a6d-bde9-0ba52c339067 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:39.062321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f4c0-09a0-4395-bd72-147eddd0650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:39.063151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f4c0-09a0-4395-bd72-147eddd0650a admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:39.063369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f4c0-09a0-4395-bd72-147eddd0650a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:39.063641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f4c0-09a0-4395-bd72-147eddd0650a admin admin] PATH_INFO: `/v3/projects/273868b1ad034ed9b764186398bc3520/users/54df3aee025d4edcbcb9c5d4124ebe32/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:39.066469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ee8811051e42fda58065defb57fc20'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.067504 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ee8811051e42fda58065defb57fc20'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.090518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582f4c0-09a0-4395-bd72-147eddd0650a admin admin] RBAC: Authorizing `identity:create_grant(project_id=273868b1ad034ed9b764186398bc3520, user_id=54df3aee025d4edcbcb9c5d4124ebe32, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:39.094335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582f4c0-09a0-4395-bd72-147eddd0650a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:39.096544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ee8811051e42fda58065defb57fc20'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.110786 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ee8811051e42fda58065defb57fc20'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.112166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-afa8c2a7-1fe1-4f28-a88e-80ea311b37f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ee8811051e42fda58065defb57fc20'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.113775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 924/1865] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:39 2022] PUT /identity/v3/projects/273868b1ad034ed9b764186398bc3520/users/54df3aee025d4edcbcb9c5d4124ebe32/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:39.114659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f4c0-09a0-4395-bd72-147eddd0650a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:39.121565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4582f4c0-09a0-4395-bd72-147eddd0650a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:39.148661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 942/1866] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:38 2022] DELETE /identity/v3/users/e9ee8811051e42fda58065defb57fc20 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:39.151878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4086-7d3a-4c16-9ba8-57282db1bf52 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:39.152380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4086-7d3a-4c16-9ba8-57282db1bf52 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:39.156536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4086-7d3a-4c16-9ba8-57282db1bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:39.201872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e9cd4086-7d3a-4c16-9ba8-57282db1bf52 None None] MFA Rules not processed for user `54df3aee025d4edcbcb9c5d4124ebe32`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:39.205275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e9cd4086-7d3a-4c16-9ba8-57282db1bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:39.257937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f4c0-09a0-4395-bd72-147eddd0650a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:39.384131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703a69f-9f53-4448-890f-83207c729bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:39.385197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a69f-9f53-4448-890f-83207c729bad admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:39.385197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a69f-9f53-4448-890f-83207c729bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:39.386989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a69f-9f53-4448-890f-83207c729bad admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:39.390732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703a69f-9f53-4448-890f-83207c729bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:39.397504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703a69f-9f53-4448-890f-83207c729bad admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:39.474551 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 943/1867] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:39.476006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd4086-7d3a-4c16-9ba8-57282db1bf52 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:39.481774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e9cd4086-7d3a-4c16-9ba8-57282db1bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:39.500435 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 925/1868] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:39 2022] POST /identity/v3/projects => generated 377 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:39.508086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703a69f-9f53-4448-890f-83207c729bad admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:39.526092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd4086-7d3a-4c16-9ba8-57282db1bf52 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:39.543238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:39.649949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:39.664304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:39.664304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:39.664304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:39.664304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] PATH_INFO: `/v3/projects/d78c51c7a78c48d494ea825499bb1e0e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:39.666004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] RBAC: Authorizing `identity:delete_project(project_id=d78c51c7a78c48d494ea825499bb1e0e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:39.668707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:39.699969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703a69f-9f53-4448-890f-83207c729bad admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:39.708055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794a6bd-b78b-4916-b05a-6913a8a4a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:39.709058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a6bd-b78b-4916-b05a-6913a8a4a88d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:39.709180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a6bd-b78b-4916-b05a-6913a8a4a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:39.709407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794a6bd-b78b-4916-b05a-6913a8a4a88d admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:39.710092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794a6bd-b78b-4916-b05a-6913a8a4a88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:39.713306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794a6bd-b78b-4916-b05a-6913a8a4a88d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:39.741185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd78c51c7a78c48d494ea825499bb1e0e', 'request_id': 'req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.745096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 926/1869] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:39 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:39.745096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794a6bd-b78b-4916-b05a-6913a8a4a88d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:39.746768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2794a6bd-b78b-4916-b05a-6913a8a4a88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:39.751390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd78c51c7a78c48d494ea825499bb1e0e', 'request_id': 'req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.760673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd78c51c7a78c48d494ea825499bb1e0e', 'request_id': 'req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.773155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] The token cache is being invalidate because project d78c51c7a78c48d494ea825499bb1e0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:39.773514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.774292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.776091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 944/1870] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:39 2022] DELETE /identity/v3/projects/d78c51c7a78c48d494ea825499bb1e0e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:39.779593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:39.780966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:39.812827 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794a6bd-b78b-4916-b05a-6913a8a4a88d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:39.845024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b05058-a3ad-44ab-926d-f7a5a2f0f7da admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:39.850696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:39.851380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:39.851655 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:39.852276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] PATH_INFO: `/v3/projects/b9385c1c58e9450c8e70b2ab2f789b37` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:39.853394 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9385c1c58e9450c8e70b2ab2f789b37)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:39.855658 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:39.863187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f523bb-96a9-41d0-9ecf-f332222e613a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:39.864059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f523bb-96a9-41d0-9ecf-f332222e613a service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:39.864344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f523bb-96a9-41d0-9ecf-f332222e613a service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:39.864675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f523bb-96a9-41d0-9ecf-f332222e613a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:39.868439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-15f523bb-96a9-41d0-9ecf-f332222e613a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:39.912151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:39.916075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9385c1c58e9450c8e70b2ab2f789b37', 'request_id': 'req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.927849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9385c1c58e9450c8e70b2ab2f789b37', 'request_id': 'req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.939423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9385c1c58e9450c8e70b2ab2f789b37', 'request_id': 'req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.941488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f523bb-96a9-41d0-9ecf-f332222e613a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:39.943291 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f523bb-96a9-41d0-9ecf-f332222e613a service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:39.953859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 927/1871] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:39.954358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] The token cache is being invalidate because project b9385c1c58e9450c8e70b2ab2f789b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:39.954859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.955559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f523bb-96a9-41d0-9ecf-f332222e613a service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:39.955776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:39.957428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-15f523bb-96a9-41d0-9ecf-f332222e613a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:39.957550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 945/1872] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:39 2022] DELETE /identity/v3/projects/b9385c1c58e9450c8e70b2ab2f789b37 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:39.958423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:39.959799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:39.975092 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f523bb-96a9-41d0-9ecf-f332222e613a service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.033512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:40.064365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043b06a-adca-4b5d-9c21-fd4b645f75fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.065013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b06a-adca-4b5d-9c21-fd4b645f75fb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.065332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b06a-adca-4b5d-9c21-fd4b645f75fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.065605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b06a-adca-4b5d-9c21-fd4b645f75fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.066274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043b06a-adca-4b5d-9c21-fd4b645f75fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.069326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043b06a-adca-4b5d-9c21-fd4b645f75fb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.073497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da38ac-8dd4-40f3-b0a2-6fe5f4540f80 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.080354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.081975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.082486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.082919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] PATH_INFO: `/v3/users/093aca917a224302bbe189618ea6cb26` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.084211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093aca917a224302bbe189618ea6cb26)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.084756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 928/1873] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:40.085604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043b06a-adca-4b5d-9c21-fd4b645f75fb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:40.087073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.087776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c043b06a-adca-4b5d-9c21-fd4b645f75fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:40.101918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043b06a-adca-4b5d-9c21-fd4b645f75fb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.106832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.107492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.107769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.108348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] PATH_INFO: `/v3/users/20da4e1c96724cc09cce61f5dd2a254c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.109594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] RBAC: Authorizing `identity:delete_user(user_id=20da4e1c96724cc09cce61f5dd2a254c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.111555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.162505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093aca917a224302bbe189618ea6cb26'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:40.163327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093aca917a224302bbe189618ea6cb26'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:40.177747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20da4e1c96724cc09cce61f5dd2a254c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:40.188144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20da4e1c96724cc09cce61f5dd2a254c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:40.189652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20da4e1c96724cc09cce61f5dd2a254c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:40.190270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093aca917a224302bbe189618ea6cb26'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:40.202551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20da4e1c96724cc09cce61f5dd2a254c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:40.203435 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-460c76e6-4753-49c5-80a9-9597b20a939a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20da4e1c96724cc09cce61f5dd2a254c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:40.205852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093aca917a224302bbe189618ea6cb26'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:40.206586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093aca917a224302bbe189618ea6cb26'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:40.230381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 929/1874] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:40 2022] DELETE /identity/v3/users/20da4e1c96724cc09cce61f5dd2a254c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:40.231678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8780d02-13be-4a26-bad2-12b9561247dd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.231961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8780d02-13be-4a26-bad2-12b9561247dd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.232372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8780d02-13be-4a26-bad2-12b9561247dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.236769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 946/1875] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:39 2022] DELETE /identity/v3/users/093aca917a224302bbe189618ea6cb26 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:40.237706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:40.239183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:40.260542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a8780d02-13be-4a26-bad2-12b9561247dd None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:40.262222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a8780d02-13be-4a26-bad2-12b9561247dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:40.321129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:40.351824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da0b11-ed35-4e49-a9e4-1e3b7571f8b0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.359905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e72ea-bb1d-4519-a03f-4836a9a6f3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.360575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e72ea-bb1d-4519-a03f-4836a9a6f3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.361025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e72ea-bb1d-4519-a03f-4836a9a6f3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.362405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e72ea-bb1d-4519-a03f-4836a9a6f3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.364192 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e72ea-bb1d-4519-a03f-4836a9a6f3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.366401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e72ea-bb1d-4519-a03f-4836a9a6f3e9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.398798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 947/1876] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:40.400069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f939c8-7ef5-49f3-99f5-bc8ae30b06e2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.400443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f939c8-7ef5-49f3-99f5-bc8ae30b06e2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.400729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f939c8-7ef5-49f3-99f5-bc8ae30b06e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.401063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 930/1877] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:40.402778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711de2c-1f75-42b1-8ae0-2597a907aa37 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.403064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711de2c-1f75-42b1-8ae0-2597a907aa37 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.404377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711de2c-1f75-42b1-8ae0-2597a907aa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.425420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f4f939c8-7ef5-49f3-99f5-bc8ae30b06e2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:40.426808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f4f939c8-7ef5-49f3-99f5-bc8ae30b06e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:40.438743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 948/1878] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:40.442102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f939c8-7ef5-49f3-99f5-bc8ae30b06e2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:40.450412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e711de2c-1f75-42b1-8ae0-2597a907aa37 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:40.452423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e711de2c-1f75-42b1-8ae0-2597a907aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:40.453950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f939c8-7ef5-49f3-99f5-bc8ae30b06e2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.461162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966388d-3df5-44ec-b9b3-5910d2d7c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.461987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966388d-3df5-44ec-b9b3-5910d2d7c113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.462388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966388d-3df5-44ec-b9b3-5910d2d7c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.462760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966388d-3df5-44ec-b9b3-5910d2d7c113 admin admin] PATH_INFO: `/v3/projects/aac08e9b11074775bf01397fb07aebc2/users/153f5595c44245c5a1659915f0a7838f/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.463601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 931/1879] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:40.464778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711de2c-1f75-42b1-8ae0-2597a907aa37 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:40.466419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e711de2c-1f75-42b1-8ae0-2597a907aa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:40.483461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966388d-3df5-44ec-b9b3-5910d2d7c113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac08e9b11074775bf01397fb07aebc2, user_id=153f5595c44245c5a1659915f0a7838f, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.487387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966388d-3df5-44ec-b9b3-5910d2d7c113 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.503556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 949/1880] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:40 2022] PUT /identity/v3/projects/aac08e9b11074775bf01397fb07aebc2/users/153f5595c44245c5a1659915f0a7838f/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:40.504612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966388d-3df5-44ec-b9b3-5910d2d7c113 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:40.535990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711de2c-1f75-42b1-8ae0-2597a907aa37 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.541116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:40.587480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966388d-3df5-44ec-b9b3-5910d2d7c113 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.592480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0d3da-062e-4df9-8f3b-8af45171146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.593134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0d3da-062e-4df9-8f3b-8af45171146d admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.593421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0d3da-062e-4df9-8f3b-8af45171146d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.593697 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0d3da-062e-4df9-8f3b-8af45171146d admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.594362 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0d3da-062e-4df9-8f3b-8af45171146d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:40.594693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0d3da-062e-4df9-8f3b-8af45171146d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.596284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0d3da-062e-4df9-8f3b-8af45171146d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.602756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c3dd6-d5c2-41fd-b82e-ce6d06f26920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.603433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3dd6-d5c2-41fd-b82e-ce6d06f26920 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.604472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3dd6-d5c2-41fd-b82e-ce6d06f26920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.604757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3dd6-d5c2-41fd-b82e-ce6d06f26920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.612757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 950/1881] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:40.612757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b99b5-e87e-4876-ad45-f4b00f107a72 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.612757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b99b5-e87e-4876-ad45-f4b00f107a72 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.612757 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b99b5-e87e-4876-ad45-f4b00f107a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.621862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c3dd6-d5c2-41fd-b82e-ce6d06f26920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.623384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c3dd6-d5c2-41fd-b82e-ce6d06f26920 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.643308 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-335b99b5-e87e-4876-ad45-f4b00f107a72 None None] MFA Rules not processed for user `153f5595c44245c5a1659915f0a7838f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:40.644510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-335b99b5-e87e-4876-ad45-f4b00f107a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:40.648665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 932/1882] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:40.649783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c3dd6-d5c2-41fd-b82e-ce6d06f26920 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:40.664209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c3dd6-d5c2-41fd-b82e-ce6d06f26920 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.670451 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779db02-1ea3-4bd6-9235-59198eee7bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.671198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779db02-1ea3-4bd6-9235-59198eee7bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.672043 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779db02-1ea3-4bd6-9235-59198eee7bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.672043 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779db02-1ea3-4bd6-9235-59198eee7bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.672685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779db02-1ea3-4bd6-9235-59198eee7bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.675248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779db02-1ea3-4bd6-9235-59198eee7bb4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.742646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 951/1883] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:40.743779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 933/1884] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:40 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:40.750017 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b99b5-e87e-4876-ad45-f4b00f107a72 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:40.750597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779db02-1ea3-4bd6-9235-59198eee7bb4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:40.766774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b99b5-e87e-4876-ad45-f4b00f107a72 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.819954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:40.842844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d03ec-e9f8-4a4d-9a0d-29a83f4bd53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.843545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d03ec-e9f8-4a4d-9a0d-29a83f4bd53b admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.843989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d03ec-e9f8-4a4d-9a0d-29a83f4bd53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.844227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d03ec-e9f8-4a4d-9a0d-29a83f4bd53b admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.844944 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d03ec-e9f8-4a4d-9a0d-29a83f4bd53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.846958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d03ec-e9f8-4a4d-9a0d-29a83f4bd53b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.874855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779db02-1ea3-4bd6-9235-59198eee7bb4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.879591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e441a8-58af-4319-bec6-eb63a80bb4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.880215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e441a8-58af-4319-bec6-eb63a80bb4db admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.880477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e441a8-58af-4319-bec6-eb63a80bb4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.880749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e441a8-58af-4319-bec6-eb63a80bb4db admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.881770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e441a8-58af-4319-bec6-eb63a80bb4db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.883709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e441a8-58af-4319-bec6-eb63a80bb4db admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.896842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 952/1885] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:40 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:40.898133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d03ec-e9f8-4a4d-9a0d-29a83f4bd53b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:40.900877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e59d03ec-e9f8-4a4d-9a0d-29a83f4bd53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:40.912299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 934/1886] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:40 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:40.916487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e441a8-58af-4319-bec6-eb63a80bb4db admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:40.926975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e441a8-58af-4319-bec6-eb63a80bb4db admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.983487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d03ec-e9f8-4a4d-9a0d-29a83f4bd53b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:40.989956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.990662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97536f4b-94f4-4d11-8dd8-8bc8501bf8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:40.991004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.991300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97536f4b-94f4-4d11-8dd8-8bc8501bf8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:40.991580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97536f4b-94f4-4d11-8dd8-8bc8501bf8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.991723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:40.991848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97536f4b-94f4-4d11-8dd8-8bc8501bf8b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.992263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] PATH_INFO: `/v3/projects/337b5e6d43e14d748b388f2f6be1c19d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:40.992510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97536f4b-94f4-4d11-8dd8-8bc8501bf8b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.993748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=337b5e6d43e14d748b388f2f6be1c19d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:40.994648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97536f4b-94f4-4d11-8dd8-8bc8501bf8b2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:40.995983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.024282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 935/1887] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:40 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:41.025170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97536f4b-94f4-4d11-8dd8-8bc8501bf8b2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.035413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97536f4b-94f4-4d11-8dd8-8bc8501bf8b2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.041353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07427b-125a-4902-ab62-a30c4391bf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.041924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07427b-125a-4902-ab62-a30c4391bf11 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.042362 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07427b-125a-4902-ab62-a30c4391bf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.042997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07427b-125a-4902-ab62-a30c4391bf11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.043178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07427b-125a-4902-ab62-a30c4391bf11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.044796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07427b-125a-4902-ab62-a30c4391bf11 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.046273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:41.060066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337b5e6d43e14d748b388f2f6be1c19d', 'request_id': 'req-1fe1429e-1d56-4310-8574-dda79cd07588'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.061645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 936/1888] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:41.062833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07427b-125a-4902-ab62-a30c4391bf11 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.066124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337b5e6d43e14d748b388f2f6be1c19d', 'request_id': 'req-1fe1429e-1d56-4310-8574-dda79cd07588'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.072944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07427b-125a-4902-ab62-a30c4391bf11 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.074688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337b5e6d43e14d748b388f2f6be1c19d', 'request_id': 'req-1fe1429e-1d56-4310-8574-dda79cd07588'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.090224 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] The token cache is being invalidate because project 337b5e6d43e14d748b388f2f6be1c19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:41.090768 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.091595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.093955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 953/1889] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:40 2022] DELETE /identity/v3/projects/337b5e6d43e14d748b388f2f6be1c19d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:41.094912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.096276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.160938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae6e97-16ef-4389-b8ec-a2dd46387fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.162138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae6e97-16ef-4389-b8ec-a2dd46387fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.162607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae6e97-16ef-4389-b8ec-a2dd46387fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.163057 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae6e97-16ef-4389-b8ec-a2dd46387fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.164059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae6e97-16ef-4389-b8ec-a2dd46387fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.165997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae6e97-16ef-4389-b8ec-a2dd46387fdc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.183960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 937/1890] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:41.185283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae6e97-16ef-4389-b8ec-a2dd46387fdc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.187603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f8ae6e97-16ef-4389-b8ec-a2dd46387fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.209017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae6e97-16ef-4389-b8ec-a2dd46387fdc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.214411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f4bf78-627e-494a-a4dd-e03f4cb6fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.215412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4bf78-627e-494a-a4dd-e03f4cb6fdee admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.215412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4bf78-627e-494a-a4dd-e03f4cb6fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.215590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f4bf78-627e-494a-a4dd-e03f4cb6fdee admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.216238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4bf78-627e-494a-a4dd-e03f4cb6fdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.217905 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f4bf78-627e-494a-a4dd-e03f4cb6fdee admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.222502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:41.231632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1429e-1d56-4310-8574-dda79cd07588 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.234864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 938/1891] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:41.236342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69ebe5-8589-47b5-9ca6-c86702522496 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.236705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69ebe5-8589-47b5-9ca6-c86702522496 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.236935 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69ebe5-8589-47b5-9ca6-c86702522496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.243518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.246822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.248379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.249336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] PATH_INFO: `/v3/projects/0dd17b9bbb824cdb95d3660650d5edc7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.251053 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd17b9bbb824cdb95d3660650d5edc7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.253230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.260748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-eb69ebe5-8589-47b5-9ca6-c86702522496 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:41.262444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eb69ebe5-8589-47b5-9ca6-c86702522496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.273364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 939/1892] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:41.274614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69ebe5-8589-47b5-9ca6-c86702522496 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.283162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eb69ebe5-8589-47b5-9ca6-c86702522496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.299262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69ebe5-8589-47b5-9ca6-c86702522496 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.306199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672267d-0edf-4a13-95de-200e4302c334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.307171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672267d-0edf-4a13-95de-200e4302c334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.307452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672267d-0edf-4a13-95de-200e4302c334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.307725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672267d-0edf-4a13-95de-200e4302c334 admin admin] PATH_INFO: `/v3/projects/42697aee449f4ba49585a85704444772/users/64ca7ace556a4c0ab0647015a9772eb8/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.323470 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd17b9bbb824cdb95d3660650d5edc7', 'request_id': 'req-76dc89fd-2be1-4aa9-a712-629874e9912f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.327877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672267d-0edf-4a13-95de-200e4302c334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42697aee449f4ba49585a85704444772, user_id=64ca7ace556a4c0ab0647015a9772eb8, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.329995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd17b9bbb824cdb95d3660650d5edc7', 'request_id': 'req-76dc89fd-2be1-4aa9-a712-629874e9912f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.330662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672267d-0edf-4a13-95de-200e4302c334 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.341684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd17b9bbb824cdb95d3660650d5edc7', 'request_id': 'req-76dc89fd-2be1-4aa9-a712-629874e9912f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.347594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 940/1893] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:41 2022] PUT /identity/v3/projects/42697aee449f4ba49585a85704444772/users/64ca7ace556a4c0ab0647015a9772eb8/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:41.348391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672267d-0edf-4a13-95de-200e4302c334 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.357858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] The token cache is being invalidate because project 0dd17b9bbb824cdb95d3660650d5edc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:41.358151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.358813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-76dc89fd-2be1-4aa9-a712-629874e9912f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.360337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 954/1894] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:41 2022] DELETE /identity/v3/projects/0dd17b9bbb824cdb95d3660650d5edc7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:41.364604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7e039-8725-49c4-8ce5-85856b029b18 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.365525 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7e039-8725-49c4-8ce5-85856b029b18 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.365525 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7e039-8725-49c4-8ce5-85856b029b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.387332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-06c7e039-8725-49c4-8ce5-85856b029b18 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:41.388802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-06c7e039-8725-49c4-8ce5-85856b029b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.422227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672267d-0edf-4a13-95de-200e4302c334 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.429010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db8b64-6455-400e-9bfe-c8ab9d18d820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.431771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db8b64-6455-400e-9bfe-c8ab9d18d820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.432129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db8b64-6455-400e-9bfe-c8ab9d18d820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.432476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db8b64-6455-400e-9bfe-c8ab9d18d820 admin admin] PATH_INFO: `/v3/projects/206caa8554844eb8a661d7e15d785198/users/719fdbb2a3314017970c8b800adb96f7/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.451877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db8b64-6455-400e-9bfe-c8ab9d18d820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=206caa8554844eb8a661d7e15d785198, user_id=719fdbb2a3314017970c8b800adb96f7, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.454651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db8b64-6455-400e-9bfe-c8ab9d18d820 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.461358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 955/1895] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:41.462383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7e039-8725-49c4-8ce5-85856b029b18 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.464781 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-06c7e039-8725-49c4-8ce5-85856b029b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.476216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 941/1896] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:41 2022] PUT /identity/v3/projects/206caa8554844eb8a661d7e15d785198/users/719fdbb2a3314017970c8b800adb96f7/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:41.478060 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db8b64-6455-400e-9bfe-c8ab9d18d820 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.488539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-91db8b64-6455-400e-9bfe-c8ab9d18d820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.489972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7e039-8725-49c4-8ce5-85856b029b18 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.534678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:41.573327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad3ede-5b4b-461b-9ae2-67ec9facf9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.573958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3ede-5b4b-461b-9ae2-67ec9facf9fb admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.574087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db8b64-6455-400e-9bfe-c8ab9d18d820 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.574237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3ede-5b4b-461b-9ae2-67ec9facf9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.574510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3ede-5b4b-461b-9ae2-67ec9facf9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.575159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad3ede-5b4b-461b-9ae2-67ec9facf9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.576910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad3ede-5b4b-461b-9ae2-67ec9facf9fb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.580272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.581019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.582259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.582370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] PATH_INFO: `/v3/users/b3f6ad2eb4f0468cb68c775c7929f46a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.584535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f6ad2eb4f0468cb68c775c7929f46a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.586855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.594351 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 956/1897] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:41.595587 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad3ede-5b4b-461b-9ae2-67ec9facf9fb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.610741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad3ede-5b4b-461b-9ae2-67ec9facf9fb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.617266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e2dbb-9016-4e95-95a2-5ddbc5042ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.618155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e2dbb-9016-4e95-95a2-5ddbc5042ced admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.618630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e2dbb-9016-4e95-95a2-5ddbc5042ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.619089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e2dbb-9016-4e95-95a2-5ddbc5042ced admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.619934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e2dbb-9016-4e95-95a2-5ddbc5042ced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:41.620434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e2dbb-9016-4e95-95a2-5ddbc5042ced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.622516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e2dbb-9016-4e95-95a2-5ddbc5042ced admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.640339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 957/1898] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:41.642163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23345643-1e38-446d-8578-3bb52c4d5949 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.642595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23345643-1e38-446d-8578-3bb52c4d5949 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.642961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23345643-1e38-446d-8578-3bb52c4d5949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.672777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f6ad2eb4f0468cb68c775c7929f46a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.690589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:41.696079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f6ad2eb4f0468cb68c775c7929f46a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.696803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f6ad2eb4f0468cb68c775c7929f46a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.697506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-23345643-1e38-446d-8578-3bb52c4d5949 None None] MFA Rules not processed for user `719fdbb2a3314017970c8b800adb96f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:41.699134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-23345643-1e38-446d-8578-3bb52c4d5949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.710875 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f6ad2eb4f0468cb68c775c7929f46a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.712391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f6ad2eb4f0468cb68c775c7929f46a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:41.748436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 942/1899] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:41 2022] DELETE /identity/v3/users/b3f6ad2eb4f0468cb68c775c7929f46a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:41.749446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.751665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.815455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 958/1900] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:41.816665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23345643-1e38-446d-8578-3bb52c4d5949 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.818492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-23345643-1e38-446d-8578-3bb52c4d5949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.834902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23345643-1e38-446d-8578-3bb52c4d5949 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.845199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20e926-cf26-40c4-a1c2-13e07365df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.845971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20e926-cf26-40c4-a1c2-13e07365df64 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.846252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20e926-cf26-40c4-a1c2-13e07365df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.846523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20e926-cf26-40c4-a1c2-13e07365df64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.847159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20e926-cf26-40c4-a1c2-13e07365df64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.847973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaf1bd-2f70-45be-ba68-e44ec3602792 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:41.851195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20e926-cf26-40c4-a1c2-13e07365df64 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.854692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b61cfc-4368-4e70-b950-299e5f8a0b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:41.856417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b61cfc-4368-4e70-b950-299e5f8a0b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:41.856772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b61cfc-4368-4e70-b950-299e5f8a0b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:41.857165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b61cfc-4368-4e70-b950-299e5f8a0b63 admin admin] PATH_INFO: `/v3/projects/42697aee449f4ba49585a85704444772/users/64ca7ace556a4c0ab0647015a9772eb8/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:41.860769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b61cfc-4368-4e70-b950-299e5f8a0b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42697aee449f4ba49585a85704444772, user_id=64ca7ace556a4c0ab0647015a9772eb8, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:41.879137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b61cfc-4368-4e70-b950-299e5f8a0b63 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:41.905229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 943/1901] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:41 2022] PUT /identity/v3/projects/42697aee449f4ba49585a85704444772/users/64ca7ace556a4c0ab0647015a9772eb8/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:41.906987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b61cfc-4368-4e70-b950-299e5f8a0b63 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.909463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-85b61cfc-4368-4e70-b950-299e5f8a0b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:41.915172 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 959/1902] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:41 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:41.922411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20e926-cf26-40c4-a1c2-13e07365df64 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:41.984322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:42.010091 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b61cfc-4368-4e70-b950-299e5f8a0b63 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.010685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20e926-cf26-40c4-a1c2-13e07365df64 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.016790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d4570-2b1b-4143-9127-48cf6218013b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.017567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d4570-2b1b-4143-9127-48cf6218013b admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.017692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5650-3ee5-4079-8f79-475bf3225104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.018030 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d4570-2b1b-4143-9127-48cf6218013b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.018310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d4570-2b1b-4143-9127-48cf6218013b admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.018588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5650-3ee5-4079-8f79-475bf3225104 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.018907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5650-3ee5-4079-8f79-475bf3225104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.019161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d4570-2b1b-4143-9127-48cf6218013b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.019271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5650-3ee5-4079-8f79-475bf3225104 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.019900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5650-3ee5-4079-8f79-475bf3225104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.021732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d4570-2b1b-4143-9127-48cf6218013b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.022181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f5650-3ee5-4079-8f79-475bf3225104 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.065696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 960/1903] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:41 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:42.068879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94a17-f467-4459-a7cc-fef48452e869 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.069419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94a17-f467-4459-a7cc-fef48452e869 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.070047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd94a17-f467-4459-a7cc-fef48452e869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.080595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 944/1904] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:41 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:42.081528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d4570-2b1b-4143-9127-48cf6218013b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.109112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-efd94a17-f467-4459-a7cc-fef48452e869 None None] MFA Rules not processed for user `64ca7ace556a4c0ab0647015a9772eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:42.110932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-efd94a17-f467-4459-a7cc-fef48452e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:42.186537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d4570-2b1b-4143-9127-48cf6218013b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.189369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:42.196727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4840d7-23e1-4339-8fd6-3a969ac41cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.197595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4840d7-23e1-4339-8fd6-3a969ac41cae admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.199386 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4840d7-23e1-4339-8fd6-3a969ac41cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.199813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4840d7-23e1-4339-8fd6-3a969ac41cae admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.200660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4840d7-23e1-4339-8fd6-3a969ac41cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.202907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 961/1905] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:42.203193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4840d7-23e1-4339-8fd6-3a969ac41cae admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.203991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd94a17-f467-4459-a7cc-fef48452e869 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.223468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 945/1906] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:42.223468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4840d7-23e1-4339-8fd6-3a969ac41cae admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.223886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd94a17-f467-4459-a7cc-fef48452e869 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.225891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6d4840d7-23e1-4339-8fd6-3a969ac41cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:42.229707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a161b0-ddaf-4da2-b37d-e71dadd5c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.230050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a161b0-ddaf-4da2-b37d-e71dadd5c11e admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.230547 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a161b0-ddaf-4da2-b37d-e71dadd5c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.230892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a161b0-ddaf-4da2-b37d-e71dadd5c11e admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.231605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a161b0-ddaf-4da2-b37d-e71dadd5c11e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.233715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a161b0-ddaf-4da2-b37d-e71dadd5c11e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.274465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 962/1907] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:42 2022] POST /identity/v3/users => generated 299 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:42.275428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a161b0-ddaf-4da2-b37d-e71dadd5c11e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.288211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a161b0-ddaf-4da2-b37d-e71dadd5c11e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.293413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950ca9-16f6-4a0e-bc21-f83788e949e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.294143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950ca9-16f6-4a0e-bc21-f83788e949e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.294500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950ca9-16f6-4a0e-bc21-f83788e949e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.294844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950ca9-16f6-4a0e-bc21-f83788e949e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.295622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa950ca9-16f6-4a0e-bc21-f83788e949e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.297448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa950ca9-16f6-4a0e-bc21-f83788e949e1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.312535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 963/1908] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:42.313597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950ca9-16f6-4a0e-bc21-f83788e949e1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.316519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4840d7-23e1-4339-8fd6-3a969ac41cae admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.322871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4daf181-115e-478e-8ea6-fbd3abb3e27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.323608 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daf181-115e-478e-8ea6-fbd3abb3e27c service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.323996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daf181-115e-478e-8ea6-fbd3abb3e27c service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.324705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950ca9-16f6-4a0e-bc21-f83788e949e1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.324831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4daf181-115e-478e-8ea6-fbd3abb3e27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.327020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d4daf181-115e-478e-8ea6-fbd3abb3e27c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:42.329916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd01752-d3fd-4cd5-9f61-46d55a65ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.330541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd01752-d3fd-4cd5-9f61-46d55a65ca7f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.330826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd01752-d3fd-4cd5-9f61-46d55a65ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.331746 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd01752-d3fd-4cd5-9f61-46d55a65ca7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.332515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd01752-d3fd-4cd5-9f61-46d55a65ca7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.335143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd01752-d3fd-4cd5-9f61-46d55a65ca7f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.350313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 964/1909] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:42.351194 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd01752-d3fd-4cd5-9f61-46d55a65ca7f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.365887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd01752-d3fd-4cd5-9f61-46d55a65ca7f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.371621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddf90c-fb68-4d2c-81f8-e704139b8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.372303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddf90c-fb68-4d2c-81f8-e704139b8f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.372696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddf90c-fb68-4d2c-81f8-e704139b8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.372974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddf90c-fb68-4d2c-81f8-e704139b8f18 admin admin] PATH_INFO: `/v3/projects/bd28753546274298932adb0bba145724/users/8ecf82dad3c2436db73c7125d11541da/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.393000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddf90c-fb68-4d2c-81f8-e704139b8f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd28753546274298932adb0bba145724, user_id=8ecf82dad3c2436db73c7125d11541da, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.395736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddf90c-fb68-4d2c-81f8-e704139b8f18 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.411309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 965/1910] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:42 2022] PUT /identity/v3/projects/bd28753546274298932adb0bba145724/users/8ecf82dad3c2436db73c7125d11541da/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:42.412376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddf90c-fb68-4d2c-81f8-e704139b8f18 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.417648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daf181-115e-478e-8ea6-fbd3abb3e27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.419369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4daf181-115e-478e-8ea6-fbd3abb3e27c service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.430377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 946/1911] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:42.431784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987479a4-eaa9-4a55-ab06-f944c8afe9c2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.432023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987479a4-eaa9-4a55-ab06-f944c8afe9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.432292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987479a4-eaa9-4a55-ab06-f944c8afe9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.464578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-987479a4-eaa9-4a55-ab06-f944c8afe9c2 None None] MFA Rules not processed for user `8ecf82dad3c2436db73c7125d11541da`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:42.466199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-987479a4-eaa9-4a55-ab06-f944c8afe9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:42.478442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:42.495040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddf90c-fb68-4d2c-81f8-e704139b8f18 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.500835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f1fc7-4734-46e8-8141-77d760013411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.501635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f1fc7-4734-46e8-8141-77d760013411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.501983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f1fc7-4734-46e8-8141-77d760013411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.502978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f1fc7-4734-46e8-8141-77d760013411 admin admin] PATH_INFO: `/v3/projects/138ef308f13746d480cf05010a6aa687/users/21d7bae7829847999da5261591471c03/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.528089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f1fc7-4734-46e8-8141-77d760013411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138ef308f13746d480cf05010a6aa687, user_id=21d7bae7829847999da5261591471c03, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.531089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f1fc7-4734-46e8-8141-77d760013411 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.556723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 966/1912] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:42 2022] PUT /identity/v3/projects/138ef308f13746d480cf05010a6aa687/users/21d7bae7829847999da5261591471c03/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:42.561521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f1fc7-4734-46e8-8141-77d760013411 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.598675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 947/1913] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:42.603431 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987479a4-eaa9-4a55-ab06-f944c8afe9c2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.640447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987479a4-eaa9-4a55-ab06-f944c8afe9c2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.667272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f1fc7-4734-46e8-8141-77d760013411 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.673959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b738f3b-8d2a-4727-9a96-25854fd04b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.674722 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b738f3b-8d2a-4727-9a96-25854fd04b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.675233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b738f3b-8d2a-4727-9a96-25854fd04b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.675754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b738f3b-8d2a-4727-9a96-25854fd04b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.676640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b738f3b-8d2a-4727-9a96-25854fd04b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.678647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b738f3b-8d2a-4727-9a96-25854fd04b7c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.690876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 967/1914] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:42.712318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b738f3b-8d2a-4727-9a96-25854fd04b7c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.713938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3b738f3b-8d2a-4727-9a96-25854fd04b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:42.742466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b738f3b-8d2a-4727-9a96-25854fd04b7c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.752987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.757123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.757429 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.757744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] PATH_INFO: `/v3/projects/9b17120a71334aaa8251a51ee536cca3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.760235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b17120a71334aaa8251a51ee536cca3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.762230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.774024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:42.775774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85aa6c4-83ff-44ab-9610-daae89eb3790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.776458 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85aa6c4-83ff-44ab-9610-daae89eb3790 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.777181 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85aa6c4-83ff-44ab-9610-daae89eb3790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.777181 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85aa6c4-83ff-44ab-9610-daae89eb3790 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.778494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85aa6c4-83ff-44ab-9610-daae89eb3790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.782774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85aa6c4-83ff-44ab-9610-daae89eb3790 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.831943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 948/1915] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:42 2022] POST /identity/v3/projects => generated 367 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:42.834745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85aa6c4-83ff-44ab-9610-daae89eb3790 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.860020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b17120a71334aaa8251a51ee536cca3', 'request_id': 'req-bdf27c8e-62ee-4218-86c2-6fef970aec8f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:42.891276 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b17120a71334aaa8251a51ee536cca3', 'request_id': 'req-bdf27c8e-62ee-4218-86c2-6fef970aec8f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:42.908442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b17120a71334aaa8251a51ee536cca3', 'request_id': 'req-bdf27c8e-62ee-4218-86c2-6fef970aec8f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:42.926471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] The token cache is being invalidate because project 9b17120a71334aaa8251a51ee536cca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:42.926866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:42.927908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:42.937508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 968/1916] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:42 2022] DELETE /identity/v3/projects/9b17120a71334aaa8251a51ee536cca3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:42.938706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:42.940377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:42.962157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85aa6c4-83ff-44ab-9610-daae89eb3790 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:42.972119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158775e0-ccbf-4a62-a7fd-e169325084d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:42.973782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158775e0-ccbf-4a62-a7fd-e169325084d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:42.974318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158775e0-ccbf-4a62-a7fd-e169325084d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:42.974852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158775e0-ccbf-4a62-a7fd-e169325084d7 admin admin] PATH_INFO: `/v3/projects/138ef308f13746d480cf05010a6aa687/users/21d7bae7829847999da5261591471c03/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:42.977937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158775e0-ccbf-4a62-a7fd-e169325084d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=138ef308f13746d480cf05010a6aa687, user_id=21d7bae7829847999da5261591471c03, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:42.981190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158775e0-ccbf-4a62-a7fd-e169325084d7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:42.997222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 949/1917] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:42 2022] PUT /identity/v3/projects/138ef308f13746d480cf05010a6aa687/users/21d7bae7829847999da5261591471c03/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:43.000660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e124ef-0cbe-46a6-b88a-d7d3cc45734b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.005910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e124ef-0cbe-46a6-b88a-d7d3cc45734b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.007299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e124ef-0cbe-46a6-b88a-d7d3cc45734b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.075192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-66e124ef-0cbe-46a6-b88a-d7d3cc45734b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:43.081658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-66e124ef-0cbe-46a6-b88a-d7d3cc45734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:43.101155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf27c8e-62ee-4218-86c2-6fef970aec8f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:43.189939 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:43.272685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633fbc8-ec43-4c46-bcaa-e75b4771ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:43.273346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633fbc8-ec43-4c46-bcaa-e75b4771ca22 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.273627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633fbc8-ec43-4c46-bcaa-e75b4771ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.273902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633fbc8-ec43-4c46-bcaa-e75b4771ca22 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.274670 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633fbc8-ec43-4c46-bcaa-e75b4771ca22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:43.276222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 950/1918] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:43.276538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633fbc8-ec43-4c46-bcaa-e75b4771ca22 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:43.281523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55fff3-1f06-42e9-b068-8d704e20f5db None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.281987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55fff3-1f06-42e9-b068-8d704e20f5db None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.282359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55fff3-1f06-42e9-b068-8d704e20f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.308500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 969/1919] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:42 2022] POST /identity/v3/users => generated 290 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:43.314907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f0ff2-e501-4236-b552-83dc0f26021a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.315287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f0ff2-e501-4236-b552-83dc0f26021a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.315577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f0ff2-e501-4236-b552-83dc0f26021a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.346225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-7a8f0ff2-e501-4236-b552-83dc0f26021a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:43.347580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7a8f0ff2-e501-4236-b552-83dc0f26021a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:43.360719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 970/1920] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:43.361855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f0ff2-e501-4236-b552-83dc0f26021a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:43.375331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f0ff2-e501-4236-b552-83dc0f26021a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:43.380677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2c55fff3-1f06-42e9-b068-8d704e20f5db None None] MFA Rules not processed for user `21d7bae7829847999da5261591471c03`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:43.383099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75fe9f-9060-4dbb-8b5e-e08fdc09eae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:43.384332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75fe9f-9060-4dbb-8b5e-e08fdc09eae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.384715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75fe9f-9060-4dbb-8b5e-e08fdc09eae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.385052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75fe9f-9060-4dbb-8b5e-e08fdc09eae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.385171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2c55fff3-1f06-42e9-b068-8d704e20f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:43.386015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75fe9f-9060-4dbb-8b5e-e08fdc09eae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:43.388005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75fe9f-9060-4dbb-8b5e-e08fdc09eae7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:43.400045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 971/1921] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:43.400909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75fe9f-9060-4dbb-8b5e-e08fdc09eae7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:43.415583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75fe9f-9060-4dbb-8b5e-e08fdc09eae7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:43.421928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202516a-0b46-47a4-a14c-13c2f50a5cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:43.422572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202516a-0b46-47a4-a14c-13c2f50a5cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.422876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202516a-0b46-47a4-a14c-13c2f50a5cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.423152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202516a-0b46-47a4-a14c-13c2f50a5cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.423816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202516a-0b46-47a4-a14c-13c2f50a5cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:43.424121 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202516a-0b46-47a4-a14c-13c2f50a5cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:43.425963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202516a-0b46-47a4-a14c-13c2f50a5cc6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:43.434226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:43.443055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 972/1922] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:43.443371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202516a-0b46-47a4-a14c-13c2f50a5cc6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:43.457001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202516a-0b46-47a4-a14c-13c2f50a5cc6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:43.464134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663a02e-c6f3-4109-84b2-c962bbeae633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:43.477340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a02e-c6f3-4109-84b2-c962bbeae633 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.477340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a02e-c6f3-4109-84b2-c962bbeae633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.477340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a02e-c6f3-4109-84b2-c962bbeae633 admin admin] PATH_INFO: `/v3/projects/0ea906a0b0584c379321859418d56bbb/users/73c8c405faa34436b80ea767700a99c8/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.508974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663a02e-c6f3-4109-84b2-c962bbeae633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea906a0b0584c379321859418d56bbb, user_id=73c8c405faa34436b80ea767700a99c8, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:43.511724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663a02e-c6f3-4109-84b2-c962bbeae633 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:43.547027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 973/1923] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:43 2022] PUT /identity/v3/projects/0ea906a0b0584c379321859418d56bbb/users/73c8c405faa34436b80ea767700a99c8/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:43.549310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 951/1924] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:43.551084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663a02e-c6f3-4109-84b2-c962bbeae633 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:43.554627 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55fff3-1f06-42e9-b068-8d704e20f5db None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:43.579772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55fff3-1f06-42e9-b068-8d704e20f5db None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:43.651295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663a02e-c6f3-4109-84b2-c962bbeae633 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:43.656637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb5a74-f6d2-4058-a7be-87ab739abaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:43.657359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb5a74-f6d2-4058-a7be-87ab739abaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.657645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb5a74-f6d2-4058-a7be-87ab739abaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.658055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb5a74-f6d2-4058-a7be-87ab739abaf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.658705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb5a74-f6d2-4058-a7be-87ab739abaf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:43.661379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb5a74-f6d2-4058-a7be-87ab739abaf9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:43.667098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fdf31-e5f6-468e-a015-5859f1f50571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:43.667733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fdf31-e5f6-468e-a015-5859f1f50571 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.668064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fdf31-e5f6-468e-a015-5859f1f50571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.668436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fdf31-e5f6-468e-a015-5859f1f50571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.669393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fdf31-e5f6-468e-a015-5859f1f50571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:43.671420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66fdf31-e5f6-468e-a015-5859f1f50571 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:43.685204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 952/1925] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:43.686358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fdf31-e5f6-468e-a015-5859f1f50571 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:43.692202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f66fdf31-e5f6-468e-a015-5859f1f50571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:43.699165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 974/1926] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:43 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:43.700930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb5a74-f6d2-4058-a7be-87ab739abaf9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:43.785551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66fdf31-e5f6-468e-a015-5859f1f50571 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:43.790670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:43.797883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb5a74-f6d2-4058-a7be-87ab739abaf9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:43.808215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2481e0b-f18a-44a3-a784-9287ed07c630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:43.808942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481e0b-f18a-44a3-a784-9287ed07c630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.809348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481e0b-f18a-44a3-a784-9287ed07c630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.809670 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481e0b-f18a-44a3-a784-9287ed07c630 admin admin] PATH_INFO: `/v3/projects/0ea906a0b0584c379321859418d56bbb/users/73c8c405faa34436b80ea767700a99c8/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.811952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2481e0b-f18a-44a3-a784-9287ed07c630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea906a0b0584c379321859418d56bbb, user_id=73c8c405faa34436b80ea767700a99c8, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:43.815536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2481e0b-f18a-44a3-a784-9287ed07c630 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:43.828363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 975/1927] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:43 2022] PUT /identity/v3/projects/0ea906a0b0584c379321859418d56bbb/users/73c8c405faa34436b80ea767700a99c8/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:43.829425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2481e0b-f18a-44a3-a784-9287ed07c630 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:43.856784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1054d-918d-4c2f-a320-ad12691e5f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:43.857828 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1054d-918d-4c2f-a320-ad12691e5f1e service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.858111 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1054d-918d-4c2f-a320-ad12691e5f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.858382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1054d-918d-4c2f-a320-ad12691e5f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.892375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:43.925416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2481e0b-f18a-44a3-a784-9287ed07c630 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:43.931690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21cb22-1eb8-491b-ab1f-e1d3cc1f7c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:43.932858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21cb22-1eb8-491b-ab1f-e1d3cc1f7c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.932858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21cb22-1eb8-491b-ab1f-e1d3cc1f7c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.932858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21cb22-1eb8-491b-ab1f-e1d3cc1f7c3d admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.933522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21cb22-1eb8-491b-ab1f-e1d3cc1f7c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:43.935849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21cb22-1eb8-491b-ab1f-e1d3cc1f7c3d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:43.946343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1054d-918d-4c2f-a320-ad12691e5f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:43.948097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1054d-918d-4c2f-a320-ad12691e5f1e service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:43.969365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 953/1928] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:43.971476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b3cdd-e2f8-490f-8534-e0d7b2aecdd4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:43.971967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 976/1929] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:43 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:43.972296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b3cdd-e2f8-490f-8534-e0d7b2aecdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:43.972848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b3cdd-e2f8-490f-8534-e0d7b2aecdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:43.976507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21cb22-1eb8-491b-ab1f-e1d3cc1f7c3d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:43.999419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21cb22-1eb8-491b-ab1f-e1d3cc1f7c3d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.009074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4523b-15e3-4ab5-8c5a-f5ad3350840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.010922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4523b-15e3-4ab5-8c5a-f5ad3350840a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.011201 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4523b-15e3-4ab5-8c5a-f5ad3350840a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.012033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4523b-15e3-4ab5-8c5a-f5ad3350840a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.012927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4523b-15e3-4ab5-8c5a-f5ad3350840a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.015703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4523b-15e3-4ab5-8c5a-f5ad3350840a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:44.018713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-929b3cdd-e2f8-490f-8534-e0d7b2aecdd4 None None] MFA Rules not processed for user `73c8c405faa34436b80ea767700a99c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:44.020043 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-929b3cdd-e2f8-490f-8534-e0d7b2aecdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:44.037855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 977/1930] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:10:44.037855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4523b-15e3-4ab5-8c5a-f5ad3350840a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:44.039071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5fb4523b-15e3-4ab5-8c5a-f5ad3350840a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:44.055585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4523b-15e3-4ab5-8c5a-f5ad3350840a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.061560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.062336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.063104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.063491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] PATH_INFO: `/v3/users/719fdbb2a3314017970c8b800adb96f7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.065420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=719fdbb2a3314017970c8b800adb96f7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.067545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:44.129319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 954/1931] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:44.130548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b3cdd-e2f8-490f-8534-e0d7b2aecdd4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:44.161903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719fdbb2a3314017970c8b800adb96f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:44.162632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b3cdd-e2f8-490f-8534-e0d7b2aecdd4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.162940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719fdbb2a3314017970c8b800adb96f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:44.168442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d5cf4-ba4d-445d-ac7c-cd7b786fc883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.169256 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5cf4-ba4d-445d-ac7c-cd7b786fc883 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.170139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5cf4-ba4d-445d-ac7c-cd7b786fc883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.170426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5cf4-ba4d-445d-ac7c-cd7b786fc883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.171708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d5cf4-ba4d-445d-ac7c-cd7b786fc883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.173632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d5cf4-ba4d-445d-ac7c-cd7b786fc883 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:44.178532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719fdbb2a3314017970c8b800adb96f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:44.191024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 955/1932] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:44.191542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d5cf4-ba4d-445d-ac7c-cd7b786fc883 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:44.194676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719fdbb2a3314017970c8b800adb96f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:44.195577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719fdbb2a3314017970c8b800adb96f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:44.218230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 978/1933] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:44 2022] DELETE /identity/v3/users/719fdbb2a3314017970c8b800adb96f7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:44.219176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:44.221162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:44.265360 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:44.299596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d5cf4-ba4d-445d-ac7c-cd7b786fc883 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.300703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb44917-1301-42f7-9be6-eecad318d2fb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.306248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc5391-d3ba-4be9-8102-504d484656c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.307837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc5391-d3ba-4be9-8102-504d484656c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.308224 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc5391-d3ba-4be9-8102-504d484656c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.308886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc5391-d3ba-4be9-8102-504d484656c3 admin admin] PATH_INFO: `/v3/projects/2a98ab173190405bb056e944fd188c59/users/d7197b99095b4be09a5a905b0ff41941/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.329102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc5391-d3ba-4be9-8102-504d484656c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a98ab173190405bb056e944fd188c59, user_id=d7197b99095b4be09a5a905b0ff41941, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.331968 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc5391-d3ba-4be9-8102-504d484656c3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:44.354690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 979/1934] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:44 2022] PUT /identity/v3/projects/2a98ab173190405bb056e944fd188c59/users/d7197b99095b4be09a5a905b0ff41941/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:44.359039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb132c4-0388-48e3-abd0-db9a3c381e0c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.359815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb132c4-0388-48e3-abd0-db9a3c381e0c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.360090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb132c4-0388-48e3-abd0-db9a3c381e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.383146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0cb132c4-0388-48e3-abd0-db9a3c381e0c None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:44.385440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0cb132c4-0388-48e3-abd0-db9a3c381e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:44.412828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:44.423133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dd44f-36d3-477b-b217-ca26e7c138ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.423651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd44f-36d3-477b-b217-ca26e7c138ab service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.423978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd44f-36d3-477b-b217-ca26e7c138ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.424245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd44f-36d3-477b-b217-ca26e7c138ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.426816 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-327dd44f-36d3-477b-b217-ca26e7c138ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:44.478559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 980/1935] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:44.480034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea55dda-feb2-4b10-97f8-c18cd62a17a6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.480388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea55dda-feb2-4b10-97f8-c18cd62a17a6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.480729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea55dda-feb2-4b10-97f8-c18cd62a17a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.512344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1ea55dda-feb2-4b10-97f8-c18cd62a17a6 None None] MFA Rules not processed for user `d7197b99095b4be09a5a905b0ff41941`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:44.513766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dd44f-36d3-477b-b217-ca26e7c138ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.514025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1ea55dda-feb2-4b10-97f8-c18cd62a17a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:44.515912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dd44f-36d3-477b-b217-ca26e7c138ab service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:44.527854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 956/1936] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:44.528840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dd44f-36d3-477b-b217-ca26e7c138ab service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:44.530324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-327dd44f-36d3-477b-b217-ca26e7c138ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:44.605727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dd44f-36d3-477b-b217-ca26e7c138ab service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.611368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 981/1937] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:44.612447 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea55dda-feb2-4b10-97f8-c18cd62a17a6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:44.628864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea55dda-feb2-4b10-97f8-c18cd62a17a6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.652528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39da1b-203d-4829-b9be-32759e55b94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.653738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39da1b-203d-4829-b9be-32759e55b94a admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.654696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39da1b-203d-4829-b9be-32759e55b94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.655139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39da1b-203d-4829-b9be-32759e55b94a admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.656101 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39da1b-203d-4829-b9be-32759e55b94a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.658610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39da1b-203d-4829-b9be-32759e55b94a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:44.708654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740ce48-2756-423a-a04a-3cd240ac334c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.709460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740ce48-2756-423a-a04a-3cd240ac334c service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.709817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740ce48-2756-423a-a04a-3cd240ac334c service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.710184 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740ce48-2756-423a-a04a-3cd240ac334c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.712935 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 982/1938] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:44 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:44.714145 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39da1b-203d-4829-b9be-32759e55b94a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:44.715911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4e39da1b-203d-4829-b9be-32759e55b94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:44.727169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740ce48-2756-423a-a04a-3cd240ac334c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.729571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740ce48-2756-423a-a04a-3cd240ac334c service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:44.737454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:44.748915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 957/1939] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:44.750501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740ce48-2756-423a-a04a-3cd240ac334c service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:44.767802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740ce48-2756-423a-a04a-3cd240ac334c service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.795546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39da1b-203d-4829-b9be-32759e55b94a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.800051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f20a-30ba-4c0b-9cc1-5c9597ecabf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.801321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f20a-30ba-4c0b-9cc1-5c9597ecabf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.801679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f20a-30ba-4c0b-9cc1-5c9597ecabf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.802024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f20a-30ba-4c0b-9cc1-5c9597ecabf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.811481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f619f20a-30ba-4c0b-9cc1-5c9597ecabf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:44.853651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67488-941f-41bc-ae30-f3345bd48e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.854285 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67488-941f-41bc-ae30-f3345bd48e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.854646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67488-941f-41bc-ae30-f3345bd48e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.854925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67488-941f-41bc-ae30-f3345bd48e1d admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.855764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb67488-941f-41bc-ae30-f3345bd48e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.857855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb67488-941f-41bc-ae30-f3345bd48e1d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:44.890425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 958/1940] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:44 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:44.893150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67488-941f-41bc-ae30-f3345bd48e1d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:44.898381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:44.907581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67488-941f-41bc-ae30-f3345bd48e1d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.912987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6500d-e33c-44f9-ac82-71a01cb9ae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.913934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6500d-e33c-44f9-ac82-71a01cb9ae2e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.914144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6500d-e33c-44f9-ac82-71a01cb9ae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.914419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6500d-e33c-44f9-ac82-71a01cb9ae2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.915182 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6500d-e33c-44f9-ac82-71a01cb9ae2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.917592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6500d-e33c-44f9-ac82-71a01cb9ae2e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:44.925008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619f20a-30ba-4c0b-9cc1-5c9597ecabf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.927915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619f20a-30ba-4c0b-9cc1-5c9597ecabf2 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:44.948322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 983/1941] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:44.949370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f20a-30ba-4c0b-9cc1-5c9597ecabf2 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:44.949708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 959/1942] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:44.965196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f20a-30ba-4c0b-9cc1-5c9597ecabf2 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:44.970482 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5935d-065b-437b-8409-6eea8a715d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:44.971347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5935d-065b-437b-8409-6eea8a715d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:44.971636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5935d-065b-437b-8409-6eea8a715d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:44.971914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5935d-065b-437b-8409-6eea8a715d37 admin admin] PATH_INFO: `/v3/projects/28ac60d9aebf482d840c0998a08f862f/users/a66d008c8dab45aca554b5954beb2b5d/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:44.989739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5935d-065b-437b-8409-6eea8a715d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ac60d9aebf482d840c0998a08f862f, user_id=a66d008c8dab45aca554b5954beb2b5d, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:44.993446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5935d-065b-437b-8409-6eea8a715d37 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:45.018299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 984/1943] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:44 2022] PUT /identity/v3/projects/28ac60d9aebf482d840c0998a08f862f/users/a66d008c8dab45aca554b5954beb2b5d/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:45.022257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6500d-e33c-44f9-ac82-71a01cb9ae2e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:45.036263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6500d-e33c-44f9-ac82-71a01cb9ae2e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:45.139279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a306e6d-4b67-4a14-82c2-22ffdd570320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:45.140668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306e6d-4b67-4a14-82c2-22ffdd570320 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:45.141068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306e6d-4b67-4a14-82c2-22ffdd570320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:45.141372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306e6d-4b67-4a14-82c2-22ffdd570320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:45.142488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a306e6d-4b67-4a14-82c2-22ffdd570320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:45.151728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a306e6d-4b67-4a14-82c2-22ffdd570320 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:45.152470 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5935d-065b-437b-8409-6eea8a715d37 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:45.155345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d0d5935d-065b-437b-8409-6eea8a715d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:45.174383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 960/1944] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:10:45.183533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a306e6d-4b67-4a14-82c2-22ffdd570320 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:45.190788 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5935d-065b-437b-8409-6eea8a715d37 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:45.206933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:45.207677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a306e6d-4b67-4a14-82c2-22ffdd570320 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:45.208424 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:45.209338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:45.209611 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] PATH_INFO: `/v3/projects/206caa8554844eb8a661d7e15d785198` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:45.212968 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=206caa8554844eb8a661d7e15d785198)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:45.215290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962976d9-2b95-45f8-99be-12b157b4d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:45.216039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962976d9-2b95-45f8-99be-12b157b4d79b admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:45.216528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962976d9-2b95-45f8-99be-12b157b4d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:45.216861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962976d9-2b95-45f8-99be-12b157b4d79b admin admin] PATH_INFO: `/v3/projects/28ac60d9aebf482d840c0998a08f862f/users/a66d008c8dab45aca554b5954beb2b5d/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:45.217121 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:45.220067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962976d9-2b95-45f8-99be-12b157b4d79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ac60d9aebf482d840c0998a08f862f, user_id=a66d008c8dab45aca554b5954beb2b5d, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:45.224696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962976d9-2b95-45f8-99be-12b157b4d79b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:45.239509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 961/1945] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:45 2022] PUT /identity/v3/projects/28ac60d9aebf482d840c0998a08f862f/users/a66d008c8dab45aca554b5954beb2b5d/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:45.250757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e720a-bd6e-44bf-9aee-041aa150d8ca None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:45.251288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e720a-bd6e-44bf-9aee-041aa150d8ca None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:45.251667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e720a-bd6e-44bf-9aee-041aa150d8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:45.304974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-705e720a-bd6e-44bf-9aee-041aa150d8ca None None] MFA Rules not processed for user `a66d008c8dab45aca554b5954beb2b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:45.306283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-705e720a-bd6e-44bf-9aee-041aa150d8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:45.318502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206caa8554844eb8a661d7e15d785198', 'request_id': 'req-550df7f3-f0f3-4ab0-8219-636632d178ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:45.352611 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206caa8554844eb8a661d7e15d785198', 'request_id': 'req-550df7f3-f0f3-4ab0-8219-636632d178ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:45.369438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206caa8554844eb8a661d7e15d785198', 'request_id': 'req-550df7f3-f0f3-4ab0-8219-636632d178ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:45.401771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] The token cache is being invalidate because project 206caa8554844eb8a661d7e15d785198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:45.402646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:45.402878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:45.403672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-550df7f3-f0f3-4ab0-8219-636632d178ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:45.409282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 985/1946] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:45 2022] DELETE /identity/v3/projects/206caa8554844eb8a661d7e15d785198 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:45.412455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae6f6-b2e5-4261-ab67-f48097fa9c78 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:45.412455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae6f6-b2e5-4261-ab67-f48097fa9c78 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:45.412708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae6f6-b2e5-4261-ab67-f48097fa9c78 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:45.418131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 986/1947] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:10:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:10:45.433335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ae6f6-b2e5-4261-ab67-f48097fa9c78 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:45.437353 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-be4ae6f6-b2e5-4261-ab67-f48097fa9c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:45.478447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 962/1948] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:10:45.479845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f0d8b-8b56-4b80-b2c4-08d3825cd371 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:45.484808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f0d8b-8b56-4b80-b2c4-08d3825cd371 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:45.485216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f0d8b-8b56-4b80-b2c4-08d3825cd371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:45.527089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5e3f0d8b-8b56-4b80-b2c4-08d3825cd371 None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:45.529628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5e3f0d8b-8b56-4b80-b2c4-08d3825cd371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:45.607533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ae6f6-b2e5-4261-ab67-f48097fa9c78 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:45.616075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:45.617026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:45.617337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:45.617612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] PATH_INFO: `/v3/users/21d7bae7829847999da5261591471c03` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:45.619695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d7bae7829847999da5261591471c03)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:45.623056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:45.646969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 963/1949] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:10:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:45.647923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f0d8b-8b56-4b80-b2c4-08d3825cd371 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:45.649719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5e3f0d8b-8b56-4b80-b2c4-08d3825cd371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:45.693156 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d7bae7829847999da5261591471c03'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:45.693879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d7bae7829847999da5261591471c03'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:45.697724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:45.718263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d7bae7829847999da5261591471c03'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:45.732581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d7bae7829847999da5261591471c03'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:45.733270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d7bae7829847999da5261591471c03'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:45.735314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f0d8b-8b56-4b80-b2c4-08d3825cd371 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:45.739673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e9cc3-4da9-4561-b8ff-beba694cb06a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:45.740500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e9cc3-4da9-4561-b8ff-beba694cb06a service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:45.740870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e9cc3-4da9-4561-b8ff-beba694cb06a service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:45.741305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e9cc3-4da9-4561-b8ff-beba694cb06a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:45.744187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-309e9cc3-4da9-4561-b8ff-beba694cb06a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:45.758460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 987/1950] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:45 2022] DELETE /identity/v3/users/21d7bae7829847999da5261591471c03 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:45.759939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:45.761480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:45.783222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e9cc3-4da9-4561-b8ff-beba694cb06a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:45.785659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e9cc3-4da9-4561-b8ff-beba694cb06a service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:45.801944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 964/1951] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:45.802980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e9cc3-4da9-4561-b8ff-beba694cb06a service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:45.804474 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-309e9cc3-4da9-4561-b8ff-beba694cb06a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:45.828510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e9cc3-4da9-4561-b8ff-beba694cb06a service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:45.844196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde948e-63bd-43f5-9749-cc07b2a46f87 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:45.853810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e53c-f485-4d72-b1c7-551f7fede383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:45.855156 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e53c-f485-4d72-b1c7-551f7fede383 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:45.858117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e53c-f485-4d72-b1c7-551f7fede383 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:45.858389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e53c-f485-4d72-b1c7-551f7fede383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:45.862478 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0846e53c-f485-4d72-b1c7-551f7fede383 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:45.961878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1511097-761c-48b9-b05e-8557e0e0e43d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:45.962645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1511097-761c-48b9-b05e-8557e0e0e43d service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:45.962929 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1511097-761c-48b9-b05e-8557e0e0e43d service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:45.963281 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1511097-761c-48b9-b05e-8557e0e0e43d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:45.965791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f1511097-761c-48b9-b05e-8557e0e0e43d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:45.978837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846e53c-f485-4d72-b1c7-551f7fede383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:45.980410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846e53c-f485-4d72-b1c7-551f7fede383 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:45.983237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1511097-761c-48b9-b05e-8557e0e0e43d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:45.985563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1511097-761c-48b9-b05e-8557e0e0e43d service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:46.001173 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 965/1952] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:46.002156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1511097-761c-48b9-b05e-8557e0e0e43d service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:46.004281 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f1511097-761c-48b9-b05e-8557e0e0e43d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:46.010545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 988/1953] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:46.018423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:46.026319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1511097-761c-48b9-b05e-8557e0e0e43d service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:46.033662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4539-dc31-462c-803e-5fd70ddc123c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:46.034214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4539-dc31-462c-803e-5fd70ddc123c service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:46.034538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4539-dc31-462c-803e-5fd70ddc123c service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:46.035415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4539-dc31-462c-803e-5fd70ddc123c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:46.037566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5e7c4539-dc31-462c-803e-5fd70ddc123c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:46.137651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c4539-dc31-462c-803e-5fd70ddc123c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:46.139132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c4539-dc31-462c-803e-5fd70ddc123c service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:46.162626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 966/1954] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:46.345077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e53c-f485-4d72-b1c7-551f7fede383 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:46.351221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0846e53c-f485-4d72-b1c7-551f7fede383 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:46.351776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4539-dc31-462c-803e-5fd70ddc123c service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:46.353262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5e7c4539-dc31-462c-803e-5fd70ddc123c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:46.478674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4539-dc31-462c-803e-5fd70ddc123c service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:46.483984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:46.485436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:46.485845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:46.486200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] PATH_INFO: `/v3/users/54df3aee025d4edcbcb9c5d4124ebe32` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:46.488472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54df3aee025d4edcbcb9c5d4124ebe32)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:46.495878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e53c-f485-4d72-b1c7-551f7fede383 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:46.499156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:46.502533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:46.503688 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:46.504360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:46.504894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] PATH_INFO: `/v3/projects/138ef308f13746d480cf05010a6aa687` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:46.507738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=138ef308f13746d480cf05010a6aa687)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:46.510305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:46.538890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:46.600019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54df3aee025d4edcbcb9c5d4124ebe32'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:46.603674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138ef308f13746d480cf05010a6aa687', 'request_id': 'req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:46.611769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138ef308f13746d480cf05010a6aa687', 'request_id': 'req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:46.613824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54df3aee025d4edcbcb9c5d4124ebe32'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:46.614665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54df3aee025d4edcbcb9c5d4124ebe32'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:46.625360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138ef308f13746d480cf05010a6aa687', 'request_id': 'req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:46.640422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54df3aee025d4edcbcb9c5d4124ebe32'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:46.642528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5c10c7d7-a602-4d79-ae16-14b251dca07c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54df3aee025d4edcbcb9c5d4124ebe32'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:46.657574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] The token cache is being invalidate because project 138ef308f13746d480cf05010a6aa687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:46.657906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:46.667618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ebf03654-e0cd-4d05-aa69-7650a0ac16a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:46.673285 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 989/1955] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:46 2022] DELETE /identity/v3/projects/138ef308f13746d480cf05010a6aa687 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:46.678162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157706-c7bf-482c-ae42-57a5f6adc5b8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:46.678606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157706-c7bf-482c-ae42-57a5f6adc5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:46.679058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157706-c7bf-482c-ae42-57a5f6adc5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:46.688999 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 967/1956] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:46 2022] DELETE /identity/v3/users/54df3aee025d4edcbcb9c5d4124ebe32 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:46.694910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16193e19-3cfc-4159-8ec2-7d3e66a8fadd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:46.695440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16193e19-3cfc-4159-8ec2-7d3e66a8fadd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:46.696269 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16193e19-3cfc-4159-8ec2-7d3e66a8fadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:46.720089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-01157706-c7bf-482c-ae42-57a5f6adc5b8 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:46.721931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-01157706-c7bf-482c-ae42-57a5f6adc5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:46.743791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-16193e19-3cfc-4159-8ec2-7d3e66a8fadd None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:46.745216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-16193e19-3cfc-4159-8ec2-7d3e66a8fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:46.765934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:46.842412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 990/1957] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:46.843580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01157706-c7bf-482c-ae42-57a5f6adc5b8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:46.846126 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-01157706-c7bf-482c-ae42-57a5f6adc5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:46.862400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01157706-c7bf-482c-ae42-57a5f6adc5b8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:46.867517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 968/1958] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:10:46.868877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911da98-cc96-4ea4-bd40-8e0282ec9b49 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:46.869195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911da98-cc96-4ea4-bd40-8e0282ec9b49 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:46.869471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911da98-cc96-4ea4-bd40-8e0282ec9b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:46.877242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:46.878427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:46.878925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:46.879497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] PATH_INFO: `/v3/users/d7197b99095b4be09a5a905b0ff41941` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:46.881485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7197b99095b4be09a5a905b0ff41941)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:46.891365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:46.897825 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b911da98-cc96-4ea4-bd40-8e0282ec9b49 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:46.899220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b911da98-cc96-4ea4-bd40-8e0282ec9b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:46.911940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 969/1959] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:46.913304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911da98-cc96-4ea4-bd40-8e0282ec9b49 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:46.916911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b911da98-cc96-4ea4-bd40-8e0282ec9b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:47.023185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7197b99095b4be09a5a905b0ff41941'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:47.025263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7197b99095b4be09a5a905b0ff41941'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:47.042472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911da98-cc96-4ea4-bd40-8e0282ec9b49 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.044231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7197b99095b4be09a5a905b0ff41941'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:47.048162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03231ca5-0791-43ec-beab-7616ea67b52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.048353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03231ca5-0791-43ec-beab-7616ea67b52f service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.048580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03231ca5-0791-43ec-beab-7616ea67b52f service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.049659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03231ca5-0791-43ec-beab-7616ea67b52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.056444 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7197b99095b4be09a5a905b0ff41941'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:47.057602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7197b99095b4be09a5a905b0ff41941'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:47.061633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03231ca5-0791-43ec-beab-7616ea67b52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.071010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03231ca5-0791-43ec-beab-7616ea67b52f service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:47.088866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 991/1960] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:46 2022] DELETE /identity/v3/users/d7197b99095b4be09a5a905b0ff41941 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:47.089804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.092581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 970/1961] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:47.093833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:47.097372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23850b6f-d888-4f77-8865-ae4aa7c3bf68 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.097622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23850b6f-d888-4f77-8865-ae4aa7c3bf68 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.098675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23850b6f-d888-4f77-8865-ae4aa7c3bf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.152465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-23850b6f-d888-4f77-8865-ae4aa7c3bf68 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:47.152465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-23850b6f-d888-4f77-8865-ae4aa7c3bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:47.162356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:47.245210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038e3d7-81b1-4e7b-8a09-310fc8c59cea admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.255610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb3c1d-6b15-4da6-968f-ea9ca30f1a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.256753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb3c1d-6b15-4da6-968f-ea9ca30f1a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.256980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb3c1d-6b15-4da6-968f-ea9ca30f1a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.257301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb3c1d-6b15-4da6-968f-ea9ca30f1a07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.258015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb3c1d-6b15-4da6-968f-ea9ca30f1a07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:47.258325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb3c1d-6b15-4da6-968f-ea9ca30f1a07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.259156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 971/1962] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:47.263637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb3c1d-6b15-4da6-968f-ea9ca30f1a07 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:47.279963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 992/1963] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:47.280558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23850b6f-d888-4f77-8865-ae4aa7c3bf68 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.280927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb3c1d-6b15-4da6-968f-ea9ca30f1a07 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.282063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-23850b6f-d888-4f77-8865-ae4aa7c3bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:47.291932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb3c1d-6b15-4da6-968f-ea9ca30f1a07 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.296702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752ed03-7558-4a92-8973-3990e105f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.297357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752ed03-7558-4a92-8973-3990e105f470 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.297644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752ed03-7558-4a92-8973-3990e105f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.297918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752ed03-7558-4a92-8973-3990e105f470 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.298687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752ed03-7558-4a92-8973-3990e105f470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.300476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752ed03-7558-4a92-8973-3990e105f470 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:47.334036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 993/1964] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:47 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:47.337947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752ed03-7558-4a92-8973-3990e105f470 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.363651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23850b6f-d888-4f77-8865-ae4aa7c3bf68 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.382910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:47.426500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49920614-3282-4797-b6e9-fc32f217babe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.427596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49920614-3282-4797-b6e9-fc32f217babe service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.428236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49920614-3282-4797-b6e9-fc32f217babe service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.428704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49920614-3282-4797-b6e9-fc32f217babe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.438862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752ed03-7558-4a92-8973-3990e105f470 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.440720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49920614-3282-4797-b6e9-fc32f217babe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.442709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49920614-3282-4797-b6e9-fc32f217babe service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:47.444713 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76985-1af4-4ea4-8f47-d1760cfd19ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.444979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76985-1af4-4ea4-8f47-d1760cfd19ff admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.445411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76985-1af4-4ea4-8f47-d1760cfd19ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.445726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca76985-1af4-4ea4-8f47-d1760cfd19ff admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.446325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca76985-1af4-4ea4-8f47-d1760cfd19ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.448318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca76985-1af4-4ea4-8f47-d1760cfd19ff admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:47.472598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 972/1965] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:47.475407 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 994/1966] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:47 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:47.480549 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49920614-3282-4797-b6e9-fc32f217babe service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.500732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49920614-3282-4797-b6e9-fc32f217babe service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.515280 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5949e-1c99-4d3b-9733-c761966456f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.517270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5949e-1c99-4d3b-9733-c761966456f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.519255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5949e-1c99-4d3b-9733-c761966456f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.519857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5949e-1c99-4d3b-9733-c761966456f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.521914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5949e-1c99-4d3b-9733-c761966456f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.523935 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5949e-1c99-4d3b-9733-c761966456f2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:47.546701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 973/1967] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:47.548119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76985-1af4-4ea4-8f47-d1760cfd19ff admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.559165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca76985-1af4-4ea4-8f47-d1760cfd19ff admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.564826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf71b3-c102-48c0-a94a-17a649c4a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.565563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf71b3-c102-48c0-a94a-17a649c4a282 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.565846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf71b3-c102-48c0-a94a-17a649c4a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.566116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf71b3-c102-48c0-a94a-17a649c4a282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.566986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf71b3-c102-48c0-a94a-17a649c4a282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.568729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf71b3-c102-48c0-a94a-17a649c4a282 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:47.580310 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 995/1968] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:47.585318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5949e-1c99-4d3b-9733-c761966456f2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.595309 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5949e-1c99-4d3b-9733-c761966456f2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.601607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44989d8f-a867-42cb-a2d9-0af3ab0cebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.602774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44989d8f-a867-42cb-a2d9-0af3ab0cebb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.602774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44989d8f-a867-42cb-a2d9-0af3ab0cebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.602977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44989d8f-a867-42cb-a2d9-0af3ab0cebb8 admin admin] PATH_INFO: `/v3/projects/13a43b63f82c4417bb18c07b1f8756ba/users/556c9efb47094001afd1d93bb08ce2a9/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.620572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44989d8f-a867-42cb-a2d9-0af3ab0cebb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a43b63f82c4417bb18c07b1f8756ba, user_id=556c9efb47094001afd1d93bb08ce2a9, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.623663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44989d8f-a867-42cb-a2d9-0af3ab0cebb8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:47.649178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 974/1969] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:47 2022] PUT /identity/v3/projects/13a43b63f82c4417bb18c07b1f8756ba/users/556c9efb47094001afd1d93bb08ce2a9/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:47.655983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341eaf-1a2b-4c7f-9adc-a9e3bc4d91b1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.656272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341eaf-1a2b-4c7f-9adc-a9e3bc4d91b1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.656846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341eaf-1a2b-4c7f-9adc-a9e3bc4d91b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.694555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44989d8f-a867-42cb-a2d9-0af3ab0cebb8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.696352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-30341eaf-1a2b-4c7f-9adc-a9e3bc4d91b1 None None] MFA Rules not processed for user `556c9efb47094001afd1d93bb08ce2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:47.696477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-44989d8f-a867-42cb-a2d9-0af3ab0cebb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:47.697958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-30341eaf-1a2b-4c7f-9adc-a9e3bc4d91b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:47.795432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:47.800605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 996/1970] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:47.805283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341eaf-1a2b-4c7f-9adc-a9e3bc4d91b1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.819156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44989d8f-a867-42cb-a2d9-0af3ab0cebb8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.823764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.824417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.824752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.825026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] PATH_INFO: `/v3/projects/273868b1ad034ed9b764186398bc3520` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.826271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273868b1ad034ed9b764186398bc3520)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.828279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:47.842339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341eaf-1a2b-4c7f-9adc-a9e3bc4d91b1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.863430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b609dbe-f5be-4b7e-8213-b830f9681730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.863430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609dbe-f5be-4b7e-8213-b830f9681730 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.863430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609dbe-f5be-4b7e-8213-b830f9681730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.863430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b609dbe-f5be-4b7e-8213-b830f9681730 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.863818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b609dbe-f5be-4b7e-8213-b830f9681730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.863818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b609dbe-f5be-4b7e-8213-b830f9681730 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:47.889988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273868b1ad034ed9b764186398bc3520', 'request_id': 'req-3f612e84-14dc-4b11-a8e2-816f7d3031a0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:47.894019 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 997/1971] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:47 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:47.894992 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b609dbe-f5be-4b7e-8213-b830f9681730 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.897403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273868b1ad034ed9b764186398bc3520', 'request_id': 'req-3f612e84-14dc-4b11-a8e2-816f7d3031a0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:47.898486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8b609dbe-f5be-4b7e-8213-b830f9681730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:47.907095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273868b1ad034ed9b764186398bc3520', 'request_id': 'req-3f612e84-14dc-4b11-a8e2-816f7d3031a0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:47.919841 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] The token cache is being invalidate because project 273868b1ad034ed9b764186398bc3520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:47.920141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:47.924565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:47.927319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 975/1972] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:47 2022] DELETE /identity/v3/projects/273868b1ad034ed9b764186398bc3520 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:47.930727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:47.930727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:47.949851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:47.977670 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b609dbe-f5be-4b7e-8213-b830f9681730 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:47.982859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:47.983547 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:47.983830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:47.984101 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] PATH_INFO: `/v3/projects/2a98ab173190405bb056e944fd188c59` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:47.985406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a98ab173190405bb056e944fd188c59)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:47.987346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:48.011991 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612e84-14dc-4b11-a8e2-816f7d3031a0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:48.018933 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdac47-0273-4fbf-979b-2b512613058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:48.019803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdac47-0273-4fbf-979b-2b512613058e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.020157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdac47-0273-4fbf-979b-2b512613058e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.020495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdac47-0273-4fbf-979b-2b512613058e admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.021237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdac47-0273-4fbf-979b-2b512613058e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:48.023228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdac47-0273-4fbf-979b-2b512613058e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:48.053238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 976/1973] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:47 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:48.055361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bbec-731f-4657-a3b1-68337af33820 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.055977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bbec-731f-4657-a3b1-68337af33820 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.056756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bbec-731f-4657-a3b1-68337af33820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.058336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a98ab173190405bb056e944fd188c59', 'request_id': 'req-7da85090-c6ca-48bb-b985-49e2af845397'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:48.067729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a98ab173190405bb056e944fd188c59', 'request_id': 'req-7da85090-c6ca-48bb-b985-49e2af845397'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:48.080883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a98ab173190405bb056e944fd188c59', 'request_id': 'req-7da85090-c6ca-48bb-b985-49e2af845397'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:48.088728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9241bbec-731f-4657-a3b1-68337af33820 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:48.090747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9241bbec-731f-4657-a3b1-68337af33820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:48.114742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] The token cache is being invalidate because project 2a98ab173190405bb056e944fd188c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:48.115557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:48.116446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:48.119987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 998/1974] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:47 2022] DELETE /identity/v3/projects/2a98ab173190405bb056e944fd188c59 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:48.121435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:48.123585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:48.229214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 977/1975] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:48.229214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241bbec-731f-4657-a3b1-68337af33820 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:48.229214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9241bbec-731f-4657-a3b1-68337af33820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:48.246730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241bbec-731f-4657-a3b1-68337af33820 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:48.258532 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:48.259959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.260117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.260389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] PATH_INFO: `/v3/users/a66d008c8dab45aca554b5954beb2b5d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.270652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66d008c8dab45aca554b5954beb2b5d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:48.278012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:48.317071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85090-c6ca-48bb-b985-49e2af845397 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:48.317071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a3244-b51a-4542-b70c-425be478e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:48.318153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3244-b51a-4542-b70c-425be478e029 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.318771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3244-b51a-4542-b70c-425be478e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.319275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a3244-b51a-4542-b70c-425be478e029 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.320576 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a3244-b51a-4542-b70c-425be478e029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:48.323980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a3244-b51a-4542-b70c-425be478e029 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:48.358539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 999/1976] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:48.361506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca10209-1987-4d72-8e20-742d32935247 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.362154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca10209-1987-4d72-8e20-742d32935247 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.362814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca10209-1987-4d72-8e20-742d32935247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.405463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:48.412942 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66d008c8dab45aca554b5954beb2b5d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:48.449677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66d008c8dab45aca554b5954beb2b5d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:48.450946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5ca10209-1987-4d72-8e20-742d32935247 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:48.451643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66d008c8dab45aca554b5954beb2b5d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:48.452464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5ca10209-1987-4d72-8e20-742d32935247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:48.463324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1000/1977] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:48.464540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca10209-1987-4d72-8e20-742d32935247 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:48.475434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca10209-1987-4d72-8e20-742d32935247 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:48.481717 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d990287-7c82-41e2-8696-c11937bebd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:48.482491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d990287-7c82-41e2-8696-c11937bebd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.482780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d990287-7c82-41e2-8696-c11937bebd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.483055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d990287-7c82-41e2-8696-c11937bebd6c admin admin] PATH_INFO: `/v3/projects/d693857b783a4841ac37a4bc51f4bc8a/users/84fc7dfad5cb4a0eb3ccdd5d9026f2a6/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.483977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66d008c8dab45aca554b5954beb2b5d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:48.485169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66d008c8dab45aca554b5954beb2b5d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:48.499795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d990287-7c82-41e2-8696-c11937bebd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d693857b783a4841ac37a4bc51f4bc8a, user_id=84fc7dfad5cb4a0eb3ccdd5d9026f2a6, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:48.502503 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d990287-7c82-41e2-8696-c11937bebd6c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:48.515153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 978/1978] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:48 2022] DELETE /identity/v3/users/a66d008c8dab45aca554b5954beb2b5d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:48.516041 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:48.517500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:48.531588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1001/1979] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:48 2022] PUT /identity/v3/projects/d693857b783a4841ac37a4bc51f4bc8a/users/84fc7dfad5cb4a0eb3ccdd5d9026f2a6/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:48.536971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d990287-7c82-41e2-8696-c11937bebd6c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:48.542364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1d990287-7c82-41e2-8696-c11937bebd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:48.558421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:48.629131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee177a3-940e-4054-adb1-997ee6696823 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:48.637156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a201f0-5ab8-4431-bf73-714e63ae97ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:48.637999 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a201f0-5ab8-4431-bf73-714e63ae97ed admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.638276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a201f0-5ab8-4431-bf73-714e63ae97ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.638558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a201f0-5ab8-4431-bf73-714e63ae97ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.639231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a201f0-5ab8-4431-bf73-714e63ae97ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:48.639755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a201f0-5ab8-4431-bf73-714e63ae97ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:48.641495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a201f0-5ab8-4431-bf73-714e63ae97ed admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:48.652375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d990287-7c82-41e2-8696-c11937bebd6c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:48.658173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf226c-f32a-4b72-b0ac-baa759433d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:48.658901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf226c-f32a-4b72-b0ac-baa759433d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.659339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf226c-f32a-4b72-b0ac-baa759433d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.659488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf226c-f32a-4b72-b0ac-baa759433d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.660758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf226c-f32a-4b72-b0ac-baa759433d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:48.661843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 979/1980] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:48.662310 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf226c-f32a-4b72-b0ac-baa759433d40 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:48.667761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a201f0-5ab8-4431-bf73-714e63ae97ed admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:48.677419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1002/1981] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:48.692200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a201f0-5ab8-4431-bf73-714e63ae97ed admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:48.694046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf226c-f32a-4b72-b0ac-baa759433d40 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:48.706002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf226c-f32a-4b72-b0ac-baa759433d40 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:48.716340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d9dd0-9e71-43d3-8ecc-5eea77d6c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:48.717067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d9dd0-9e71-43d3-8ecc-5eea77d6c479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.717354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d9dd0-9e71-43d3-8ecc-5eea77d6c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.717628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d9dd0-9e71-43d3-8ecc-5eea77d6c479 admin admin] PATH_INFO: `/v3/projects/d693857b783a4841ac37a4bc51f4bc8a/users/84fc7dfad5cb4a0eb3ccdd5d9026f2a6/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.719609 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d9dd0-9e71-43d3-8ecc-5eea77d6c479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d693857b783a4841ac37a4bc51f4bc8a, user_id=84fc7dfad5cb4a0eb3ccdd5d9026f2a6, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:48.722469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d9dd0-9e71-43d3-8ecc-5eea77d6c479 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:48.735860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06e0d3-aa94-4b35-a3f0-57a0fec5b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:48.737636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06e0d3-aa94-4b35-a3f0-57a0fec5b2ac admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.738068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06e0d3-aa94-4b35-a3f0-57a0fec5b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.738169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06e0d3-aa94-4b35-a3f0-57a0fec5b2ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.745671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06e0d3-aa94-4b35-a3f0-57a0fec5b2ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:48.747750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06e0d3-aa94-4b35-a3f0-57a0fec5b2ac admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:48.769180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1003/1982] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:48 2022] PUT /identity/v3/projects/d693857b783a4841ac37a4bc51f4bc8a/users/84fc7dfad5cb4a0eb3ccdd5d9026f2a6/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:48.771570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159aa4e3-27c4-4b35-8716-0f4d7d61706f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.771862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159aa4e3-27c4-4b35-8716-0f4d7d61706f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.772133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159aa4e3-27c4-4b35-8716-0f4d7d61706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.820324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 980/1983] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:48 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:48.821255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06e0d3-aa94-4b35-a3f0-57a0fec5b2ac admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:48.849105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-159aa4e3-27c4-4b35-8716-0f4d7d61706f None None] MFA Rules not processed for user `84fc7dfad5cb4a0eb3ccdd5d9026f2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:48.849105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-159aa4e3-27c4-4b35-8716-0f4d7d61706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:48.942148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06e0d3-aa94-4b35-a3f0-57a0fec5b2ac admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:48.967515 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076d70f-4a1f-47cb-be2e-000792310282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:48.968991 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076d70f-4a1f-47cb-be2e-000792310282 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:48.969515 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076d70f-4a1f-47cb-be2e-000792310282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:48.970160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076d70f-4a1f-47cb-be2e-000792310282 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:48.970985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076d70f-4a1f-47cb-be2e-000792310282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:48.973723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076d70f-4a1f-47cb-be2e-000792310282 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.018440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 981/1984] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:48 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:49.023168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076d70f-4a1f-47cb-be2e-000792310282 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:49.047767 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076d70f-4a1f-47cb-be2e-000792310282 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:49.057538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef3f03-23fe-446e-b214-13093bf3f375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:49.059994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef3f03-23fe-446e-b214-13093bf3f375 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.060383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef3f03-23fe-446e-b214-13093bf3f375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.060834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef3f03-23fe-446e-b214-13093bf3f375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.061774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef3f03-23fe-446e-b214-13093bf3f375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:49.065090 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef3f03-23fe-446e-b214-13093bf3f375 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.093254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 982/1985] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:49.097996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef3f03-23fe-446e-b214-13093bf3f375 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:49.122794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef3f03-23fe-446e-b214-13093bf3f375 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:49.137356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1004/1986] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:10:49.151235 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097b95a-b9d5-4a11-9355-7133fbb66158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:49.152964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097b95a-b9d5-4a11-9355-7133fbb66158 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.153168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097b95a-b9d5-4a11-9355-7133fbb66158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.153418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097b95a-b9d5-4a11-9355-7133fbb66158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.154129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097b95a-b9d5-4a11-9355-7133fbb66158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:49.162557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097b95a-b9d5-4a11-9355-7133fbb66158 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.169084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159aa4e3-27c4-4b35-8716-0f4d7d61706f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:49.170596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-159aa4e3-27c4-4b35-8716-0f4d7d61706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:49.183031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 983/1987] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:49.186351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097b95a-b9d5-4a11-9355-7133fbb66158 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:49.204412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097b95a-b9d5-4a11-9355-7133fbb66158 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:49.210064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159aa4e3-27c4-4b35-8716-0f4d7d61706f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:49.211692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2792d2-040a-4bb6-93b2-bf88f67e8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:49.212537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2792d2-040a-4bb6-93b2-bf88f67e8237 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.212903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2792d2-040a-4bb6-93b2-bf88f67e8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.213216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2792d2-040a-4bb6-93b2-bf88f67e8237 admin admin] PATH_INFO: `/v3/projects/c4f2c2ad9305476ba01f0f6332ab6562/users/234c60b117eb482781811947e543b33f/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.216791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:49.217827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.218296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.218729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] PATH_INFO: `/v3/projects/28ac60d9aebf482d840c0998a08f862f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.220050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ac60d9aebf482d840c0998a08f862f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:49.222875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.234645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2792d2-040a-4bb6-93b2-bf88f67e8237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f2c2ad9305476ba01f0f6332ab6562, user_id=234c60b117eb482781811947e543b33f, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:49.237381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2792d2-040a-4bb6-93b2-bf88f67e8237 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.253026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 984/1988] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:49 2022] PUT /identity/v3/projects/c4f2c2ad9305476ba01f0f6332ab6562/users/234c60b117eb482781811947e543b33f/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:49.254425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2792d2-040a-4bb6-93b2-bf88f67e8237 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:49.256755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5e2792d2-040a-4bb6-93b2-bf88f67e8237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:49.303519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:49.304725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:49.318771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ac60d9aebf482d840c0998a08f862f', 'request_id': 'req-404f8c2b-c94a-47f2-ab20-99ab233b083b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:49.337161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ac60d9aebf482d840c0998a08f862f', 'request_id': 'req-404f8c2b-c94a-47f2-ab20-99ab233b083b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:49.347103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2792d2-040a-4bb6-93b2-bf88f67e8237 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:49.349699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ac60d9aebf482d840c0998a08f862f', 'request_id': 'req-404f8c2b-c94a-47f2-ab20-99ab233b083b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:49.365433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] The token cache is being invalidate because project 28ac60d9aebf482d840c0998a08f862f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:49.365776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:49.366449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-404f8c2b-c94a-47f2-ab20-99ab233b083b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:49.373259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1005/1989] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:49 2022] DELETE /identity/v3/projects/28ac60d9aebf482d840c0998a08f862f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:49.375163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa10a5-9b5f-4870-ae66-ce94c9338d64 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.375614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa10a5-9b5f-4870-ae66-ce94c9338d64 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.375900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa10a5-9b5f-4870-ae66-ce94c9338d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.408272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2baa10a5-9b5f-4870-ae66-ce94c9338d64 None None] MFA Rules not processed for user `234c60b117eb482781811947e543b33f`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:49.409583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2baa10a5-9b5f-4870-ae66-ce94c9338d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:49.419365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0ac33-4fa3-4545-8237-e4ba33db96f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:49.419997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0ac33-4fa3-4545-8237-e4ba33db96f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.420278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0ac33-4fa3-4545-8237-e4ba33db96f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.420552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0ac33-4fa3-4545-8237-e4ba33db96f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.423122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-57a0ac33-4fa3-4545-8237-e4ba33db96f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:49.512914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0ac33-4fa3-4545-8237-e4ba33db96f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:49.514703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0ac33-4fa3-4545-8237-e4ba33db96f3 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.515897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1006/1990] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:49.517078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbfe5c-b075-48b4-8cbb-1d040e9a19ee None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.517365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbfe5c-b075-48b4-8cbb-1d040e9a19ee None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.517641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbfe5c-b075-48b4-8cbb-1d040e9a19ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.526941 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 985/1991] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:49.541742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-07cbfe5c-b075-48b4-8cbb-1d040e9a19ee None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:49.543035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-07cbfe5c-b075-48b4-8cbb-1d040e9a19ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:49.663085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1007/1992] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:49.670998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314b10-9768-4709-ace1-d4ede738b275 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.671333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314b10-9768-4709-ace1-d4ede738b275 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.671626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314b10-9768-4709-ace1-d4ede738b275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.699000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a6314b10-9768-4709-ace1-d4ede738b275 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:49.700405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a6314b10-9768-4709-ace1-d4ede738b275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:49.705153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbfe5c-b075-48b4-8cbb-1d040e9a19ee None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:49.707316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-07cbfe5c-b075-48b4-8cbb-1d040e9a19ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:49.715601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 986/1993] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:49.719758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6314b10-9768-4709-ace1-d4ede738b275 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:49.728667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbfe5c-b075-48b4-8cbb-1d040e9a19ee None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:49.735136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe7205-8484-4bbb-a124-8d98e03d30da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:49.735772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe7205-8484-4bbb-a124-8d98e03d30da service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.736082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe7205-8484-4bbb-a124-8d98e03d30da service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.736418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe7205-8484-4bbb-a124-8d98e03d30da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.739333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6314b10-9768-4709-ace1-d4ede738b275 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:49.745171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7ac66-c973-4efe-81dd-29333a628e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:49.745849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7ac66-c973-4efe-81dd-29333a628e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.746380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7ac66-c973-4efe-81dd-29333a628e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.747216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7ac66-c973-4efe-81dd-29333a628e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.747893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7ac66-c973-4efe-81dd-29333a628e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:49.748201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7ac66-c973-4efe-81dd-29333a628e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:49.749630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe7205-8484-4bbb-a124-8d98e03d30da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:49.749896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7ac66-c973-4efe-81dd-29333a628e15 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.751326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe7205-8484-4bbb-a124-8d98e03d30da service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.767048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 987/1994] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:49.767303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1008/1995] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:49.768245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7ac66-c973-4efe-81dd-29333a628e15 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:49.779120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7ac66-c973-4efe-81dd-29333a628e15 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:49.785958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f78d8-3edc-4825-8da5-64b3d1757c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:49.786993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f78d8-3edc-4825-8da5-64b3d1757c3c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.787286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f78d8-3edc-4825-8da5-64b3d1757c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.787532 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f78d8-3edc-4825-8da5-64b3d1757c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.788176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f78d8-3edc-4825-8da5-64b3d1757c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:49.790150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f78d8-3edc-4825-8da5-64b3d1757c3c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.819800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 988/1996] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:49 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:49.823971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe7205-8484-4bbb-a124-8d98e03d30da service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:49.836069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe7205-8484-4bbb-a124-8d98e03d30da service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:49.880815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:49.901460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c01978-6436-48d6-9db0-8a4b2f5bd108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:49.910638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c01978-6436-48d6-9db0-8a4b2f5bd108 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.910638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c01978-6436-48d6-9db0-8a4b2f5bd108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.910638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c01978-6436-48d6-9db0-8a4b2f5bd108 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.910638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c01978-6436-48d6-9db0-8a4b2f5bd108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:49.910638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c01978-6436-48d6-9db0-8a4b2f5bd108 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.936670 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1009/1997] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:49 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:49.940642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f78d8-3edc-4825-8da5-64b3d1757c3c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:49.951652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f78d8-3edc-4825-8da5-64b3d1757c3c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:49.963548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce34e73-6322-4412-b682-c1f6ee927a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:49.964192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce34e73-6322-4412-b682-c1f6ee927a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:49.964501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce34e73-6322-4412-b682-c1f6ee927a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:49.964743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce34e73-6322-4412-b682-c1f6ee927a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:49.967893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce34e73-6322-4412-b682-c1f6ee927a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:49.969826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce34e73-6322-4412-b682-c1f6ee927a8e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:49.983255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 989/1998] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:49.987368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c01978-6436-48d6-9db0-8a4b2f5bd108 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:50.003988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c01978-6436-48d6-9db0-8a4b2f5bd108 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:50.010960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3186f47-3a3d-437d-bddd-5b024a03665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:50.011920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3186f47-3a3d-437d-bddd-5b024a03665a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:50.012220 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3186f47-3a3d-437d-bddd-5b024a03665a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:50.012709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3186f47-3a3d-437d-bddd-5b024a03665a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:50.017905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3186f47-3a3d-437d-bddd-5b024a03665a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:50.021066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3186f47-3a3d-437d-bddd-5b024a03665a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:50.035568 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1010/1999] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:50.040444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce34e73-6322-4412-b682-c1f6ee927a8e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:50.051231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce34e73-6322-4412-b682-c1f6ee927a8e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:50.056284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0a542-66f2-458a-8a4f-8a1b3714374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:50.057081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0a542-66f2-458a-8a4f-8a1b3714374e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:50.065079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0a542-66f2-458a-8a4f-8a1b3714374e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:50.065079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0a542-66f2-458a-8a4f-8a1b3714374e admin admin] PATH_INFO: `/v3/projects/43bdc817194d431fb9b956139731aa47/users/7d2407d7b7e848f08c158073ce90d94b/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:50.076184 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0a542-66f2-458a-8a4f-8a1b3714374e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bdc817194d431fb9b956139731aa47, user_id=7d2407d7b7e848f08c158073ce90d94b, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:50.079384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0a542-66f2-458a-8a4f-8a1b3714374e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:50.098965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 990/2000] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:50 2022] PUT /identity/v3/projects/43bdc817194d431fb9b956139731aa47/users/7d2407d7b7e848f08c158073ce90d94b/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:50.114871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd48c6-19c3-44dd-97a2-0862352efcae None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:50.115486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd48c6-19c3-44dd-97a2-0862352efcae None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:50.115917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd48c6-19c3-44dd-97a2-0862352efcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:50.181028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-12fd48c6-19c3-44dd-97a2-0862352efcae None None] MFA Rules not processed for user `7d2407d7b7e848f08c158073ce90d94b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:50.182621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-12fd48c6-19c3-44dd-97a2-0862352efcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:50.325994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1011/2001] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:50.395531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0a542-66f2-458a-8a4f-8a1b3714374e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:50.419319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:50.457361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0a542-66f2-458a-8a4f-8a1b3714374e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:50.461123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52d05f-7678-4aca-9e86-69ca01a9649c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:50.461838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d05f-7678-4aca-9e86-69ca01a9649c service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:50.462110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d05f-7678-4aca-9e86-69ca01a9649c service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:50.462382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52d05f-7678-4aca-9e86-69ca01a9649c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:50.471728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52d05f-7678-4aca-9e86-69ca01a9649c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:50.473326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52d05f-7678-4aca-9e86-69ca01a9649c service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:50.482821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 991/2002] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:50.502294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd48c6-19c3-44dd-97a2-0862352efcae None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:50.566953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52d05f-7678-4aca-9e86-69ca01a9649c service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:50.578535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd48c6-19c3-44dd-97a2-0862352efcae None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:50.584007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:50.584663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:50.584943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:50.585342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] PATH_INFO: `/v3/users/7d2407d7b7e848f08c158073ce90d94b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:50.586523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2407d7b7e848f08c158073ce90d94b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:50.588524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:50.645985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52d05f-7678-4aca-9e86-69ca01a9649c service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:50.647245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2407d7b7e848f08c158073ce90d94b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:50.647944 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2407d7b7e848f08c158073ce90d94b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:50.652163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34811f9-b039-4c0e-9975-9180fe1bd5f0 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fc7dfad5cb4a0eb3ccdd5d9026f2a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd693857b783a4841ac37a4bc51f4bc8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:50.652758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:50.654222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34811f9-b039-4c0e-9975-9180fe1bd5f0 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:50.654222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34811f9-b039-4c0e-9975-9180fe1bd5f0 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:50.654581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34811f9-b039-4c0e-9975-9180fe1bd5f0 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:50.655233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34811f9-b039-4c0e-9975-9180fe1bd5f0 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:50.655542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34811f9-b039-4c0e-9975-9180fe1bd5f0 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:50.657975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34811f9-b039-4c0e-9975-9180fe1bd5f0 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:50.675681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 992/2003] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:10:50.678022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2407d7b7e848f08c158073ce90d94b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:50.681220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34811f9-b039-4c0e-9975-9180fe1bd5f0 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:50.691808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2407d7b7e848f08c158073ce90d94b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:50.692698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-54d7bfe4-5708-4c82-a7e3-11abe5796e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2407d7b7e848f08c158073ce90d94b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:50.699354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34811f9-b039-4c0e-9975-9180fe1bd5f0 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:50.705304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c967-191a-43ec-b149-d3841a4abfc8 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fc7dfad5cb4a0eb3ccdd5d9026f2a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd693857b783a4841ac37a4bc51f4bc8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:50.706042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c967-191a-43ec-b149-d3841a4abfc8 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:50.706384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c967-191a-43ec-b149-d3841a4abfc8 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:50.707471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c967-191a-43ec-b149-d3841a4abfc8 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:50.708586 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576c967-191a-43ec-b149-d3841a4abfc8 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:50.710968 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576c967-191a-43ec-b149-d3841a4abfc8 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:50.711093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1012/2004] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:50 2022] DELETE /identity/v3/users/7d2407d7b7e848f08c158073ce90d94b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:50.716307 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7d02-7d18-469b-ae3f-9cec63cfb44a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:50.716682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7d02-7d18-469b-ae3f-9cec63cfb44a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:50.717105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7d02-7d18-469b-ae3f-9cec63cfb44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:50.743415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f58e7d02-7d18-469b-ae3f-9cec63cfb44a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:50.744964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f58e7d02-7d18-469b-ae3f-9cec63cfb44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:50.767413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 993/2005] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:50 2022] POST /identity/v3/projects => generated 354 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:50.769420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c967-191a-43ec-b149-d3841a4abfc8 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:50.776267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5576c967-191a-43ec-b149-d3841a4abfc8 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:50.852558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1013/2006] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:50.859837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7d02-7d18-469b-ae3f-9cec63cfb44a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:50.861741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f58e7d02-7d18-469b-ae3f-9cec63cfb44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:50.881950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c967-191a-43ec-b149-d3841a4abfc8 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:50.888471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42855dcc-46f7-4c4d-a7c8-f173b0177987 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fc7dfad5cb4a0eb3ccdd5d9026f2a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd693857b783a4841ac37a4bc51f4bc8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:50.889130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42855dcc-46f7-4c4d-a7c8-f173b0177987 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:50.889440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42855dcc-46f7-4c4d-a7c8-f173b0177987 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:50.890013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42855dcc-46f7-4c4d-a7c8-f173b0177987 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:50.890375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42855dcc-46f7-4c4d-a7c8-f173b0177987 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:50.890681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42855dcc-46f7-4c4d-a7c8-f173b0177987 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:50.892359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42855dcc-46f7-4c4d-a7c8-f173b0177987 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:50.907770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 994/2007] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:50.944612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7d02-7d18-469b-ae3f-9cec63cfb44a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:50.960114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42855dcc-46f7-4c4d-a7c8-f173b0177987 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:50.979443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42855dcc-46f7-4c4d-a7c8-f173b0177987 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:50.985076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fc7dfad5cb4a0eb3ccdd5d9026f2a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd693857b783a4841ac37a4bc51f4bc8a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:50.986131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:50.986414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:50.986693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] PATH_INFO: `/v3/projects/e1fa8179bd174c85a6d5fa7da5a37dbd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:50.988018 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e1fa8179bd174c85a6d5fa7da5a37dbd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:50.990046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:51.016573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:51.020748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54069009-6a6b-4a28-9dc8-b21b15925792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:51.021521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54069009-6a6b-4a28-9dc8-b21b15925792 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:51.021937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54069009-6a6b-4a28-9dc8-b21b15925792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:51.022148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54069009-6a6b-4a28-9dc8-b21b15925792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:51.043406 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1fa8179bd174c85a6d5fa7da5a37dbd', 'request_id': 'req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.049952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1fa8179bd174c85a6d5fa7da5a37dbd', 'request_id': 'req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.057550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1fa8179bd174c85a6d5fa7da5a37dbd', 'request_id': 'req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.063646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:51.070167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] The token cache is being invalidate because project e1fa8179bd174c85a6d5fa7da5a37dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:51.070520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.071242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.073121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 995/2008] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:50 2022] DELETE /identity/v3/projects/e1fa8179bd174c85a6d5fa7da5a37dbd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:51.091161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54069009-6a6b-4a28-9dc8-b21b15925792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:51.091161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54069009-6a6b-4a28-9dc8-b21b15925792 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:51.101967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1014/2009] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:10:51.401671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:51.403342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:51.485388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54069009-6a6b-4a28-9dc8-b21b15925792 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:51.487538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-54069009-6a6b-4a28-9dc8-b21b15925792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:51.523786 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54069009-6a6b-4a28-9dc8-b21b15925792 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:51.563621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa99da0-cd0f-4695-8ab9-7d0894b7ac75 tempest-VolumeQuotaClassesTest-143230745 tempest-VolumeQuotaClassesTest-143230745-project-admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:51.580246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:51.580246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:51.582341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:51.582341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] PATH_INFO: `/v3/users/556c9efb47094001afd1d93bb08ce2a9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:51.584213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=556c9efb47094001afd1d93bb08ce2a9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:51.587981 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:51.705712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:51.714375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:51.714375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:51.714375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] PATH_INFO: `/v3/projects/43bdc817194d431fb9b956139731aa47` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:51.714375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43bdc817194d431fb9b956139731aa47)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:51.714375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:51.735029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '556c9efb47094001afd1d93bb08ce2a9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.754131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '556c9efb47094001afd1d93bb08ce2a9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.766498 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '556c9efb47094001afd1d93bb08ce2a9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.790914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '556c9efb47094001afd1d93bb08ce2a9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.792695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4fa1241b-d138-4361-a47e-3fc2bb914357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '556c9efb47094001afd1d93bb08ce2a9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.808759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bdc817194d431fb9b956139731aa47', 'request_id': 'req-56f71a1d-c41d-425b-b31a-e246562bbee5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.815183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bdc817194d431fb9b956139731aa47', 'request_id': 'req-56f71a1d-c41d-425b-b31a-e246562bbee5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.829761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bdc817194d431fb9b956139731aa47', 'request_id': 'req-56f71a1d-c41d-425b-b31a-e246562bbee5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.847253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 996/2010] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:51 2022] DELETE /identity/v3/users/556c9efb47094001afd1d93bb08ce2a9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:51.855887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb3d07-1e96-4232-9d2a-85920f209b75 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:51.856541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb3d07-1e96-4232-9d2a-85920f209b75 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:51.857132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb3d07-1e96-4232-9d2a-85920f209b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:51.862637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] The token cache is being invalidate because project 43bdc817194d431fb9b956139731aa47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:51.862950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.864224 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-56f71a1d-c41d-425b-b31a-e246562bbee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:51.867387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1015/2011] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:51 2022] DELETE /identity/v3/projects/43bdc817194d431fb9b956139731aa47 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:51.875496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ab68e-8a7d-4ba6-a0b7-5c2a8ebf39e0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:51.875811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ab68e-8a7d-4ba6-a0b7-5c2a8ebf39e0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:51.876090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ab68e-8a7d-4ba6-a0b7-5c2a8ebf39e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:51.895485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0bfb3d07-1e96-4232-9d2a-85920f209b75 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:51.897351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0bfb3d07-1e96-4232-9d2a-85920f209b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:51.916689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-497ab68e-8a7d-4ba6-a0b7-5c2a8ebf39e0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:51.918705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-497ab68e-8a7d-4ba6-a0b7-5c2a8ebf39e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:51.931853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:51.994686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 997/2012] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:52.006530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb3d07-1e96-4232-9d2a-85920f209b75 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:52.010136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0bfb3d07-1e96-4232-9d2a-85920f209b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:52.051401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1016/2013] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:52.062055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551d82-a0e4-484b-bb99-fc62237f0ab3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.063214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551d82-a0e4-484b-bb99-fc62237f0ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.064751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551d82-a0e4-484b-bb99-fc62237f0ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.100544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:52.119246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-08551d82-a0e4-484b-bb99-fc62237f0ab3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:52.120612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-08551d82-a0e4-484b-bb99-fc62237f0ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:52.159227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb3d07-1e96-4232-9d2a-85920f209b75 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:52.165385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7273f5-0d2b-4450-b98a-2d6a9b07ffc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:52.166015 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7273f5-0d2b-4450-b98a-2d6a9b07ffc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.166408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7273f5-0d2b-4450-b98a-2d6a9b07ffc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.166691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7273f5-0d2b-4450-b98a-2d6a9b07ffc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.169350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1017/2014] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:52.170902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08551d82-a0e4-484b-bb99-fc62237f0ab3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:52.183102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7273f5-0d2b-4450-b98a-2d6a9b07ffc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:52.184985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7273f5-0d2b-4450-b98a-2d6a9b07ffc8 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:52.200539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08551d82-a0e4-484b-bb99-fc62237f0ab3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:52.207789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f56cbd-65ae-45ad-946a-f66e897bf5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:52.208560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56cbd-65ae-45ad-946a-f66e897bf5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.208943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56cbd-65ae-45ad-946a-f66e897bf5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.209355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f56cbd-65ae-45ad-946a-f66e897bf5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.210170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f56cbd-65ae-45ad-946a-f66e897bf5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:52.210626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f56cbd-65ae-45ad-946a-f66e897bf5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:52.211045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 998/2015] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:52.213097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f56cbd-65ae-45ad-946a-f66e897bf5aa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:52.231403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1018/2016] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:10:52.241940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7273f5-0d2b-4450-b98a-2d6a9b07ffc8 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:52.268829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7273f5-0d2b-4450-b98a-2d6a9b07ffc8 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:52.292938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9620e-a6ac-4bb1-b6a3-6dce0d3f4cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:52.294633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9620e-a6ac-4bb1-b6a3-6dce0d3f4cbb admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.294917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9620e-a6ac-4bb1-b6a3-6dce0d3f4cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.295189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9620e-a6ac-4bb1-b6a3-6dce0d3f4cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.296053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9620e-a6ac-4bb1-b6a3-6dce0d3f4cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:52.301458 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9620e-a6ac-4bb1-b6a3-6dce0d3f4cbb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:52.380368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 999/2017] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:52 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:52.382204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f56cbd-65ae-45ad-946a-f66e897bf5aa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:52.395696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f56cbd-65ae-45ad-946a-f66e897bf5aa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:52.540566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88107-fe30-4911-a796-973f11dfd815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:52.541233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88107-fe30-4911-a796-973f11dfd815 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.541514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88107-fe30-4911-a796-973f11dfd815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.541789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88107-fe30-4911-a796-973f11dfd815 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.542434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef88107-fe30-4911-a796-973f11dfd815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:52.544475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef88107-fe30-4911-a796-973f11dfd815 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:52.562599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9620e-a6ac-4bb1-b6a3-6dce0d3f4cbb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:52.564530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-23a9620e-a6ac-4bb1-b6a3-6dce0d3f4cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:52.584235 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9620e-a6ac-4bb1-b6a3-6dce0d3f4cbb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:52.592813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1019/2018] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:52 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:52.597437 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88107-fe30-4911-a796-973f11dfd815 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:52.598944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:52.600466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.602466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.602995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] PATH_INFO: `/v3/users/8ecf82dad3c2436db73c7125d11541da` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.606430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecf82dad3c2436db73c7125d11541da)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:52.609444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:52.634493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88107-fe30-4911-a796-973f11dfd815 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:52.650570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d4468-6df3-4db8-9b1c-b1a18cbfcd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:52.651304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d4468-6df3-4db8-9b1c-b1a18cbfcd43 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.651505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d4468-6df3-4db8-9b1c-b1a18cbfcd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.651763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d4468-6df3-4db8-9b1c-b1a18cbfcd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.653715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d4468-6df3-4db8-9b1c-b1a18cbfcd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:52.655523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d4468-6df3-4db8-9b1c-b1a18cbfcd43 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:52.672023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1020/2019] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:52.676491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d4468-6df3-4db8-9b1c-b1a18cbfcd43 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:52.690037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d4468-6df3-4db8-9b1c-b1a18cbfcd43 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:52.697274 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929a9d1-45b5-4472-aa7d-4980fe491d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:52.697962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929a9d1-45b5-4472-aa7d-4980fe491d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.698250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929a9d1-45b5-4472-aa7d-4980fe491d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.698529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929a9d1-45b5-4472-aa7d-4980fe491d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.699185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929a9d1-45b5-4472-aa7d-4980fe491d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:52.701315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929a9d1-45b5-4472-aa7d-4980fe491d09 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:52.717579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1021/2020] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:52.718373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929a9d1-45b5-4472-aa7d-4980fe491d09 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:52.724076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecf82dad3c2436db73c7125d11541da'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:52.731435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929a9d1-45b5-4472-aa7d-4980fe491d09 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:52.733767 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecf82dad3c2436db73c7125d11541da'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:52.734606 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecf82dad3c2436db73c7125d11541da'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:52.744831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5f342-ac67-4d5c-9603-b5b3419652bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:52.745642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecf82dad3c2436db73c7125d11541da'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:52.746890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5f342-ac67-4d5c-9603-b5b3419652bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.747176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5f342-ac67-4d5c-9603-b5b3419652bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.747456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5f342-ac67-4d5c-9603-b5b3419652bd admin admin] PATH_INFO: `/v3/projects/0acbff4bb83e4e60a20e53792c7abf7e/users/b4dfa908b0da4c96b5ff4ce428363544/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.748593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3f5709a2-d94c-4b98-a51f-b0ee1d057f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecf82dad3c2436db73c7125d11541da'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:52.774732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1000/2021] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:52 2022] DELETE /identity/v3/users/8ecf82dad3c2436db73c7125d11541da => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:52.777496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e111-33ff-4149-a055-525666f4e83e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.777646 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e111-33ff-4149-a055-525666f4e83e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.777914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e111-33ff-4149-a055-525666f4e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.785596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5f342-ac67-4d5c-9603-b5b3419652bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acbff4bb83e4e60a20e53792c7abf7e, user_id=b4dfa908b0da4c96b5ff4ce428363544, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:52.791986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5f342-ac67-4d5c-9603-b5b3419652bd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:52.803952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ec36e111-33ff-4149-a055-525666f4e83e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:52.805633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ec36e111-33ff-4149-a055-525666f4e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:52.823343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1022/2022] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:52 2022] PUT /identity/v3/projects/0acbff4bb83e4e60a20e53792c7abf7e/users/b4dfa908b0da4c96b5ff4ce428363544/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:52.833864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658d798-8600-4eae-862c-928b22fb233a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.834240 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658d798-8600-4eae-862c-928b22fb233a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.834599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658d798-8600-4eae-862c-928b22fb233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.835504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:52.870596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f658d798-8600-4eae-862c-928b22fb233a None None] MFA Rules not processed for user `b4dfa908b0da4c96b5ff4ce428363544`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:52.871835 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f658d798-8600-4eae-862c-928b22fb233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:52.901001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1001/2023] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:52.902176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36e111-33ff-4149-a055-525666f4e83e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:52.903456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ec36e111-33ff-4149-a055-525666f4e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:52.915685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36e111-33ff-4149-a055-525666f4e83e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:52.949175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1023/2024] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:52.950405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658d798-8600-4eae-862c-928b22fb233a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:52.951743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f658d798-8600-4eae-862c-928b22fb233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:52.972703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:52.980632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:52.981375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:52.981654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:52.981923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] PATH_INFO: `/v3/projects/13a43b63f82c4417bb18c07b1f8756ba` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:52.983060 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a43b63f82c4417bb18c07b1f8756ba)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:52.984973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:53.008617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658d798-8600-4eae-862c-928b22fb233a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:53.012985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b84038-15fe-4daa-ad82-3a73f1ae5474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:53.013797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b84038-15fe-4daa-ad82-3a73f1ae5474 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:53.014052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b84038-15fe-4daa-ad82-3a73f1ae5474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:53.014338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b84038-15fe-4daa-ad82-3a73f1ae5474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:53.023651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b84038-15fe-4daa-ad82-3a73f1ae5474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:53.025115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b84038-15fe-4daa-ad82-3a73f1ae5474 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:53.033308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a43b63f82c4417bb18c07b1f8756ba', 'request_id': 'req-32975ea0-7fcd-4eb6-98af-15164474e0ae'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.037095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1024/2025] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:53.038070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b84038-15fe-4daa-ad82-3a73f1ae5474 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:53.039473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-33b84038-15fe-4daa-ad82-3a73f1ae5474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:53.063375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a43b63f82c4417bb18c07b1f8756ba', 'request_id': 'req-32975ea0-7fcd-4eb6-98af-15164474e0ae'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.080682 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a43b63f82c4417bb18c07b1f8756ba', 'request_id': 'req-32975ea0-7fcd-4eb6-98af-15164474e0ae'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.105361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] The token cache is being invalidate because project 13a43b63f82c4417bb18c07b1f8756ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:53.105777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.106560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.108375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1002/2026] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:52 2022] DELETE /identity/v3/projects/13a43b63f82c4417bb18c07b1f8756ba => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:53.112460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:53.114303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:53.119862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b84038-15fe-4daa-ad82-3a73f1ae5474 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:53.175996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1375116-3034-4b48-a92a-3b48e6bf227f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:53.176620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375116-3034-4b48-a92a-3b48e6bf227f service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:53.176926 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375116-3034-4b48-a92a-3b48e6bf227f service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:53.177214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375116-3034-4b48-a92a-3b48e6bf227f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:53.179041 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b1375116-3034-4b48-a92a-3b48e6bf227f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:53.200474 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:53.206400 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32975ea0-7fcd-4eb6-98af-15164474e0ae admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:53.214612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:53.215276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:53.215561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:53.215842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] PATH_INFO: `/v3/users/84fc7dfad5cb4a0eb3ccdd5d9026f2a6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:53.217061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84fc7dfad5cb4a0eb3ccdd5d9026f2a6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:53.219153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:53.256565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1375116-3034-4b48-a92a-3b48e6bf227f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:53.258066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1375116-3034-4b48-a92a-3b48e6bf227f service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:53.267799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1025/2027] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:53.282591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84fc7dfad5cb4a0eb3ccdd5d9026f2a6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.294691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84fc7dfad5cb4a0eb3ccdd5d9026f2a6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.295647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84fc7dfad5cb4a0eb3ccdd5d9026f2a6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.306668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84fc7dfad5cb4a0eb3ccdd5d9026f2a6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.308342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84fc7dfad5cb4a0eb3ccdd5d9026f2a6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.332332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1003/2028] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:53 2022] DELETE /identity/v3/users/84fc7dfad5cb4a0eb3ccdd5d9026f2a6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:53.525607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1375116-3034-4b48-a92a-3b48e6bf227f service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:53.529163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b1375116-3034-4b48-a92a-3b48e6bf227f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:53.572171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1375116-3034-4b48-a92a-3b48e6bf227f service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:53.662938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:53.699833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:53.700545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:53.700834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:53.701143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] PATH_INFO: `/v3/projects/bd28753546274298932adb0bba145724` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:53.702314 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd28753546274298932adb0bba145724)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:53.705389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:53.757067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:53.761993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:53.787447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c89cb8-acd0-42af-8a55-9ae9e97d8310 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:53.808800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd28753546274298932adb0bba145724', 'request_id': 'req-d416e8d8-4ccf-4548-8783-f4e68582bb40'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.817016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd28753546274298932adb0bba145724', 'request_id': 'req-d416e8d8-4ccf-4548-8783-f4e68582bb40'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.831374 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd28753546274298932adb0bba145724', 'request_id': 'req-d416e8d8-4ccf-4548-8783-f4e68582bb40'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.865509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] The token cache is being invalidate because project bd28753546274298932adb0bba145724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:53.865818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.866607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.870413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1026/2029] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:53 2022] DELETE /identity/v3/projects/bd28753546274298932adb0bba145724 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:53.876886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:53.882408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:53.900983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:53.901758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:53.902107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:53.902450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] PATH_INFO: `/v3/users/234c60b117eb482781811947e543b33f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:53.903739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=234c60b117eb482781811947e543b33f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:53.905755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:53.966262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234c60b117eb482781811947e543b33f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.977416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234c60b117eb482781811947e543b33f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.978531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416e8d8-4ccf-4548-8783-f4e68582bb40 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:53.980567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234c60b117eb482781811947e543b33f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.986703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:53.987685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:53.988010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:53.988384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] PATH_INFO: `/v3/users/73c8c405faa34436b80ea767700a99c8` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:53.989782 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c8c405faa34436b80ea767700a99c8)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:53.991967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:53.997362 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234c60b117eb482781811947e543b33f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:53.998353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234c60b117eb482781811947e543b33f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.013005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:54.023761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1004/2030] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:53 2022] DELETE /identity/v3/users/234c60b117eb482781811947e543b33f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:54.024885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:54.026725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:54.063559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c8c405faa34436b80ea767700a99c8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.064292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c8c405faa34436b80ea767700a99c8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.086984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c8c405faa34436b80ea767700a99c8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.092505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:54.098482 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c8c405faa34436b80ea767700a99c8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.099895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f246dbaa-8760-48a6-bac6-c11535c59acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c8c405faa34436b80ea767700a99c8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.106866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f86c8-fb59-46f6-83b2-568b0b9ad51d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:54.114117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:54.116708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.117018 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.117452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] PATH_INFO: `/v3/projects/d693857b783a4841ac37a4bc51f4bc8a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.118975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d693857b783a4841ac37a4bc51f4bc8a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:54.119221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1027/2031] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:53 2022] DELETE /identity/v3/users/73c8c405faa34436b80ea767700a99c8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:54.121238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:54.122828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14093ac-f316-4e97-952e-1d8b0004cf16 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.123321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14093ac-f316-4e97-952e-1d8b0004cf16 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.123995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14093ac-f316-4e97-952e-1d8b0004cf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.163178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f14093ac-f316-4e97-952e-1d8b0004cf16 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:54.166407 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f14093ac-f316-4e97-952e-1d8b0004cf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:54.195431 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd693857b783a4841ac37a4bc51f4bc8a', 'request_id': 'req-99e73f3a-4f63-41be-99c7-976fcc58b4f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.205847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd693857b783a4841ac37a4bc51f4bc8a', 'request_id': 'req-99e73f3a-4f63-41be-99c7-976fcc58b4f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.222593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd693857b783a4841ac37a4bc51f4bc8a', 'request_id': 'req-99e73f3a-4f63-41be-99c7-976fcc58b4f0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.239207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1028/2032] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:54.240929 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] The token cache is being invalidate because project d693857b783a4841ac37a4bc51f4bc8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:54.241259 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.242405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.244171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1005/2033] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:54 2022] DELETE /identity/v3/projects/d693857b783a4841ac37a4bc51f4bc8a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:54.249993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b8bd-8d24-403b-b38a-b2e7a80692c7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.250344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b8bd-8d24-403b-b38a-b2e7a80692c7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.250679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b8bd-8d24-403b-b38a-b2e7a80692c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.254771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:54.257969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:54.278447 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e873b8bd-8d24-403b-b38a-b2e7a80692c7 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:54.279850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e873b8bd-8d24-403b-b38a-b2e7a80692c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:54.381886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e73f3a-4f63-41be-99c7-976fcc58b4f0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:54.393719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dfc0d-6704-41b7-8225-c62b03fc06ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:54.396346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfc0d-6704-41b7-8225-c62b03fc06ea service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.396667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfc0d-6704-41b7-8225-c62b03fc06ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.396951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfc0d-6704-41b7-8225-c62b03fc06ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.405952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-611dfc0d-6704-41b7-8225-c62b03fc06ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:54.406608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1029/2034] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:54.408188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87acb-7d76-4f7c-9d8e-2a820cb2d51e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.408589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87acb-7d76-4f7c-9d8e-2a820cb2d51e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.412469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87acb-7d76-4f7c-9d8e-2a820cb2d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.437338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-03e87acb-7d76-4f7c-9d8e-2a820cb2d51e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:54.438765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-03e87acb-7d76-4f7c-9d8e-2a820cb2d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:54.442893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dfc0d-6704-41b7-8225-c62b03fc06ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:54.444128 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dfc0d-6704-41b7-8225-c62b03fc06ea service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:54.455483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1006/2035] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:54.471949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1030/2036] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:54.475940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dfc0d-6704-41b7-8225-c62b03fc06ea service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:54.487248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dfc0d-6704-41b7-8225-c62b03fc06ea service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:54.499186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70886b03-63d3-490a-8f76-29392a1a1480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:54.500068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70886b03-63d3-490a-8f76-29392a1a1480 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.500472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70886b03-63d3-490a-8f76-29392a1a1480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.502041 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70886b03-63d3-490a-8f76-29392a1a1480 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.502901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70886b03-63d3-490a-8f76-29392a1a1480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:54.503270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70886b03-63d3-490a-8f76-29392a1a1480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:54.505201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70886b03-63d3-490a-8f76-29392a1a1480 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:54.523445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1007/2037] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:54.527065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e87acb-7d76-4f7c-9d8e-2a820cb2d51e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:54.541483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e87acb-7d76-4f7c-9d8e-2a820cb2d51e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:54.548848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5958496-9adc-498f-84ee-a70933cdf3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:54.549942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958496-9adc-498f-84ee-a70933cdf3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.551481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958496-9adc-498f-84ee-a70933cdf3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.551993 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958496-9adc-498f-84ee-a70933cdf3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.553509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5958496-9adc-498f-84ee-a70933cdf3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:54.556059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5958496-9adc-498f-84ee-a70933cdf3b9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:54.604372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1031/2038] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:54 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:54.608207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70886b03-63d3-490a-8f76-29392a1a1480 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:54.618748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70886b03-63d3-490a-8f76-29392a1a1480 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:54.631408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:54.685588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5958496-9adc-498f-84ee-a70933cdf3b9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:54.687661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b5958496-9adc-498f-84ee-a70933cdf3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:54.717434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2041200-67d9-43d0-b940-7cdd5300431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:54.718071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041200-67d9-43d0-b940-7cdd5300431c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.718350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041200-67d9-43d0-b940-7cdd5300431c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.718621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041200-67d9-43d0-b940-7cdd5300431c admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.719330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2041200-67d9-43d0-b940-7cdd5300431c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:54.721333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2041200-67d9-43d0-b940-7cdd5300431c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:54.764167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1008/2039] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:54 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:54.770190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2041200-67d9-43d0-b940-7cdd5300431c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:54.798676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2041200-67d9-43d0-b940-7cdd5300431c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:54.805466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dffca-e97e-4ff7-9f16-b65e15f0a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:54.806094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dffca-e97e-4ff7-9f16-b65e15f0a27e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.806372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dffca-e97e-4ff7-9f16-b65e15f0a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.806642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dffca-e97e-4ff7-9f16-b65e15f0a27e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.807783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6dffca-e97e-4ff7-9f16-b65e15f0a27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:54.808655 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:54.810108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6dffca-e97e-4ff7-9f16-b65e15f0a27e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:54.818316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5958496-9adc-498f-84ee-a70933cdf3b9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:54.836980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:54.837663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.838007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.838283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] PATH_INFO: `/v3/projects/0ea906a0b0584c379321859418d56bbb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.840052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1009/2040] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:54.840967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea906a0b0584c379321859418d56bbb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:54.841579 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dffca-e97e-4ff7-9f16-b65e15f0a27e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:54.843852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:54.873206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dffca-e97e-4ff7-9f16-b65e15f0a27e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:54.884354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f812ff4-21f9-4a8e-8277-0ced42f3c099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:54.885558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f812ff4-21f9-4a8e-8277-0ced42f3c099 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.885946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f812ff4-21f9-4a8e-8277-0ced42f3c099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.886221 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f812ff4-21f9-4a8e-8277-0ced42f3c099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.886891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f812ff4-21f9-4a8e-8277-0ced42f3c099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:54.888920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f812ff4-21f9-4a8e-8277-0ced42f3c099 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:54.906460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1010/2041] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:54.911580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f812ff4-21f9-4a8e-8277-0ced42f3c099 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:54.930970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f812ff4-21f9-4a8e-8277-0ced42f3c099 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:54.950130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9ddc-b4d4-4574-bb45-27f25787d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:54.957756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9ddc-b4d4-4574-bb45-27f25787d19f admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:54.958058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9ddc-b4d4-4574-bb45-27f25787d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:54.958683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9ddc-b4d4-4574-bb45-27f25787d19f admin admin] PATH_INFO: `/v3/projects/164d6a7d05d8472fbf77c9cdc9816de4/users/c734355102894dc1a200c7f32e984f1a/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:54.979145 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea906a0b0584c379321859418d56bbb', 'request_id': 'req-440547c6-15ee-4864-982f-dbf167f65ea4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:54.995327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea906a0b0584c379321859418d56bbb', 'request_id': 'req-440547c6-15ee-4864-982f-dbf167f65ea4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:55.001283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed9ddc-b4d4-4574-bb45-27f25787d19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=164d6a7d05d8472fbf77c9cdc9816de4, user_id=c734355102894dc1a200c7f32e984f1a, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.004729 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed9ddc-b4d4-4574-bb45-27f25787d19f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.013248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea906a0b0584c379321859418d56bbb', 'request_id': 'req-440547c6-15ee-4864-982f-dbf167f65ea4'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:55.029506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] The token cache is being invalidate because project 0ea906a0b0584c379321859418d56bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:55.029953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:55.031080 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-440547c6-15ee-4864-982f-dbf167f65ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:55.033010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1032/2042] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:54 2022] DELETE /identity/v3/projects/0ea906a0b0584c379321859418d56bbb => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:10:55.042754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9ccf3-64d3-4ca8-a90b-1b83774902e9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.043922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9ccf3-64d3-4ca8-a90b-1b83774902e9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.044867 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9ccf3-64d3-4ca8-a90b-1b83774902e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.052456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1011/2043] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:54 2022] PUT /identity/v3/projects/164d6a7d05d8472fbf77c9cdc9816de4/users/c734355102894dc1a200c7f32e984f1a/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:55.063209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6265ac6-4947-4d09-894e-5fae848e7018 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.064960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6265ac6-4947-4d09-894e-5fae848e7018 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.064960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6265ac6-4947-4d09-894e-5fae848e7018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.091421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-35e9ccf3-64d3-4ca8-a90b-1b83774902e9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:55.096940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-35e9ccf3-64d3-4ca8-a90b-1b83774902e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:55.144677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f6265ac6-4947-4d09-894e-5fae848e7018 None None] MFA Rules not processed for user `c734355102894dc1a200c7f32e984f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:55.146184 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f6265ac6-4947-4d09-894e-5fae848e7018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:55.222215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1033/2044] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:55.233994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc7023-5e49-4812-9b66-038288fec3b3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.235505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc7023-5e49-4812-9b66-038288fec3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.235505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc7023-5e49-4812-9b66-038288fec3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.264825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-59bc7023-5e49-4812-9b66-038288fec3b3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:55.266273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-59bc7023-5e49-4812-9b66-038288fec3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:55.278291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1034/2045] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:55.278465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1012/2046] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:10:55.280609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6265ac6-4947-4d09-894e-5fae848e7018 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.280800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc7023-5e49-4812-9b66-038288fec3b3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.282636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f6265ac6-4947-4d09-894e-5fae848e7018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:55.292141 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc7023-5e49-4812-9b66-038288fec3b3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.300196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ab8ad-4a08-4ab0-95e1-14db20b8a7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.301064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ab8ad-4a08-4ab0-95e1-14db20b8a7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.301452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ab8ad-4a08-4ab0-95e1-14db20b8a7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.301753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6265ac6-4947-4d09-894e-5fae848e7018 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.301886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ab8ad-4a08-4ab0-95e1-14db20b8a7cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.302515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ab8ad-4a08-4ab0-95e1-14db20b8a7cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:55.302885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ab8ad-4a08-4ab0-95e1-14db20b8a7cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.304606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ab8ad-4a08-4ab0-95e1-14db20b8a7cc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.306480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b410e0-41a7-4483-bceb-607a676baacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.307104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b410e0-41a7-4483-bceb-607a676baacb admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.308357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b410e0-41a7-4483-bceb-607a676baacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.308357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b410e0-41a7-4483-bceb-607a676baacb admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.308357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b410e0-41a7-4483-bceb-607a676baacb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.311387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b410e0-41a7-4483-bceb-607a676baacb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.321505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1035/2047] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:10:55.322730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ab8ad-4a08-4ab0-95e1-14db20b8a7cc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.334523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ab8ad-4a08-4ab0-95e1-14db20b8a7cc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.340855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fdcec-d632-487d-bf57-2467b8d4cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.341561 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fdcec-d632-487d-bf57-2467b8d4cc04 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.341819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fdcec-d632-487d-bf57-2467b8d4cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.342100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fdcec-d632-487d-bf57-2467b8d4cc04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.342747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fdcec-d632-487d-bf57-2467b8d4cc04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.344846 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fdcec-d632-487d-bf57-2467b8d4cc04 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.354086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1013/2048] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:55 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:55.358800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b410e0-41a7-4483-bceb-607a676baacb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.381902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1036/2049] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:55 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:55.397150 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fdcec-d632-487d-bf57-2467b8d4cc04 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.402836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:55.455306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b410e0-41a7-4483-bceb-607a676baacb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.492114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:55.520062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fdcec-d632-487d-bf57-2467b8d4cc04 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.525303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5814e-68f6-4808-878a-2bc5a9afeefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.525939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5814e-68f6-4808-878a-2bc5a9afeefb admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.526222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5814e-68f6-4808-878a-2bc5a9afeefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.526495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5814e-68f6-4808-878a-2bc5a9afeefb admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.527254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5814e-68f6-4808-878a-2bc5a9afeefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.529558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5814e-68f6-4808-878a-2bc5a9afeefb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.536734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a83a40-78a3-4236-a567-3f88129b94bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.537656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83a40-78a3-4236-a567-3f88129b94bb admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.538386 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83a40-78a3-4236-a567-3f88129b94bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.538866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a83a40-78a3-4236-a567-3f88129b94bb admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.540430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a83a40-78a3-4236-a567-3f88129b94bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.544217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a83a40-78a3-4236-a567-3f88129b94bb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.560411 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1037/2050] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:55 2022] POST /identity/v3/users => generated 283 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:55.565335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5814e-68f6-4808-878a-2bc5a9afeefb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.579891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5814e-68f6-4808-878a-2bc5a9afeefb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.593418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc59fb-1a77-4671-917f-6284ebc4347c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.596228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc59fb-1a77-4671-917f-6284ebc4347c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.596527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc59fb-1a77-4671-917f-6284ebc4347c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.597069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc59fb-1a77-4671-917f-6284ebc4347c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.597637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc59fb-1a77-4671-917f-6284ebc4347c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.598846 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1014/2051] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:55 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:55.602397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a83a40-78a3-4236-a567-3f88129b94bb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.604082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc59fb-1a77-4671-917f-6284ebc4347c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.610637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-13a83a40-78a3-4236-a567-3f88129b94bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:55.620813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1038/2052] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:55.623793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a83a40-78a3-4236-a567-3f88129b94bb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.626181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc59fb-1a77-4671-917f-6284ebc4347c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.628595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.629353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.629707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.630018 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] PATH_INFO: `/v3/projects/c4f2c2ad9305476ba01f0f6332ab6562` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.632417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f2c2ad9305476ba01f0f6332ab6562)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.634400 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.640182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc59fb-1a77-4671-917f-6284ebc4347c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.651199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f63e-7813-469b-b917-bab9e70ef0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.653243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f63e-7813-469b-b917-bab9e70ef0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.653680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f63e-7813-469b-b917-bab9e70ef0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.654015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2f63e-7813-469b-b917-bab9e70ef0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.655309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2f63e-7813-469b-b917-bab9e70ef0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.657805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2f63e-7813-469b-b917-bab9e70ef0e0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.670140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1039/2053] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:55.671173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f63e-7813-469b-b917-bab9e70ef0e0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.684651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2f63e-7813-469b-b917-bab9e70ef0e0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.690218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92693f29-9474-4171-8dc9-3f51b3f52ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.691061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693f29-9474-4171-8dc9-3f51b3f52ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.691487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693f29-9474-4171-8dc9-3f51b3f52ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.691826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693f29-9474-4171-8dc9-3f51b3f52ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.692655 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92693f29-9474-4171-8dc9-3f51b3f52ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.694487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92693f29-9474-4171-8dc9-3f51b3f52ed8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.702581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f2c2ad9305476ba01f0f6332ab6562', 'request_id': 'req-b1611102-e292-4429-bfe9-8f71a43b5c1f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:55.709071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1040/2054] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:55.709071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92693f29-9474-4171-8dc9-3f51b3f52ed8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.711719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f2c2ad9305476ba01f0f6332ab6562', 'request_id': 'req-b1611102-e292-4429-bfe9-8f71a43b5c1f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:55.717451 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92693f29-9474-4171-8dc9-3f51b3f52ed8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.720772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f2c2ad9305476ba01f0f6332ab6562', 'request_id': 'req-b1611102-e292-4429-bfe9-8f71a43b5c1f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:55.736889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] The token cache is being invalidate because project c4f2c2ad9305476ba01f0f6332ab6562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:55.737900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:55.739676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:55.745268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1015/2055] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:55 2022] DELETE /identity/v3/projects/c4f2c2ad9305476ba01f0f6332ab6562 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:55.745268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.745268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:55.786667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9ccc-079c-4e35-be67-e5c4b769a636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.787343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9ccc-079c-4e35-be67-e5c4b769a636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.787625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9ccc-079c-4e35-be67-e5c4b769a636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.787957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9ccc-079c-4e35-be67-e5c4b769a636 admin admin] PATH_INFO: `/v3/projects/e230248bb0ba42578a68352d94b0b924/users/d92fdaec9af8468ea2fbae6e4b073f8d/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.797482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:55.806684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f9ccc-079c-4e35-be67-e5c4b769a636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e230248bb0ba42578a68352d94b0b924, user_id=d92fdaec9af8468ea2fbae6e4b073f8d, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.809440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f9ccc-079c-4e35-be67-e5c4b769a636 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.818926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1611102-e292-4429-bfe9-8f71a43b5c1f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.825452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1041/2056] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:55 2022] PUT /identity/v3/projects/e230248bb0ba42578a68352d94b0b924/users/d92fdaec9af8468ea2fbae6e4b073f8d/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:55.826484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3389bd-6828-4230-9306-66c7655efac4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.826775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3389bd-6828-4230-9306-66c7655efac4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.827052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3389bd-6828-4230-9306-66c7655efac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.848034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-aa3389bd-6828-4230-9306-66c7655efac4 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:55.849619 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aa3389bd-6828-4230-9306-66c7655efac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:55.891270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6517b25-82ad-4d93-aa01-19d9132a271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:55.892098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517b25-82ad-4d93-aa01-19d9132a271c admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.892382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517b25-82ad-4d93-aa01-19d9132a271c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.892651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517b25-82ad-4d93-aa01-19d9132a271c admin admin] PATH_INFO: `/v3/projects/03e42efa532b45fb93ae5a30084762fd/users/d5b0a01123b643d899a855e1ff6cded6/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.910354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6517b25-82ad-4d93-aa01-19d9132a271c admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e42efa532b45fb93ae5a30084762fd, user_id=d5b0a01123b643d899a855e1ff6cded6, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:55.913309 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6517b25-82ad-4d93-aa01-19d9132a271c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:55.920628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1042/2057] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:55.920628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3389bd-6828-4230-9306-66c7655efac4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:55.920628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aa3389bd-6828-4230-9306-66c7655efac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:55.930754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3389bd-6828-4230-9306-66c7655efac4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:55.933064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1016/2058] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:55 2022] PUT /identity/v3/projects/03e42efa532b45fb93ae5a30084762fd/users/d5b0a01123b643d899a855e1ff6cded6/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:55.934427 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78f228-9b79-4af2-94ba-03f4357c0fe8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:55.935330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78f228-9b79-4af2-94ba-03f4357c0fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:55.935330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78f228-9b79-4af2-94ba-03f4357c0fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:55.962165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:55.968945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ed78f228-9b79-4af2-94ba-03f4357c0fe8 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:55.972678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ed78f228-9b79-4af2-94ba-03f4357c0fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:56.005719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f109b6-75f1-4c67-b5d4-cfa898fcea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:56.006642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f109b6-75f1-4c67-b5d4-cfa898fcea89 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.006930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f109b6-75f1-4c67-b5d4-cfa898fcea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.007203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f109b6-75f1-4c67-b5d4-cfa898fcea89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.008213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f109b6-75f1-4c67-b5d4-cfa898fcea89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:56.009538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f109b6-75f1-4c67-b5d4-cfa898fcea89 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:56.019833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1043/2059] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:56.021072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342dd5e-38d9-4a27-a847-2de2a429939d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.021367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342dd5e-38d9-4a27-a847-2de2a429939d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.021646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342dd5e-38d9-4a27-a847-2de2a429939d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.040397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1017/2060] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:56.041441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78f228-9b79-4af2-94ba-03f4357c0fe8 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:56.053349 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a342dd5e-38d9-4a27-a847-2de2a429939d None None] MFA Rules not processed for user `d5b0a01123b643d899a855e1ff6cded6`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:56.054585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a342dd5e-38d9-4a27-a847-2de2a429939d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:56.054773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78f228-9b79-4af2-94ba-03f4357c0fe8 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:56.060163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8762a-eb66-4608-9a8a-8c338dc80119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:56.060837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8762a-eb66-4608-9a8a-8c338dc80119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.061145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8762a-eb66-4608-9a8a-8c338dc80119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.061422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8762a-eb66-4608-9a8a-8c338dc80119 admin admin] PATH_INFO: `/v3/projects/e230248bb0ba42578a68352d94b0b924/users/d92fdaec9af8468ea2fbae6e4b073f8d/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.063761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8762a-eb66-4608-9a8a-8c338dc80119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e230248bb0ba42578a68352d94b0b924, user_id=d92fdaec9af8468ea2fbae6e4b073f8d, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:56.068103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8762a-eb66-4608-9a8a-8c338dc80119 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:56.081307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1018/2061] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:56 2022] PUT /identity/v3/projects/e230248bb0ba42578a68352d94b0b924/users/d92fdaec9af8468ea2fbae6e4b073f8d/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:56.082297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8762a-eb66-4608-9a8a-8c338dc80119 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:56.121258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1044/2062] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:56.126200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03409f1-8c20-4365-ac8d-485058d1d5d7 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.126492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03409f1-8c20-4365-ac8d-485058d1d5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.126774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03409f1-8c20-4365-ac8d-485058d1d5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.162165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8762a-eb66-4608-9a8a-8c338dc80119 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:56.167390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3caada-a42e-4461-9b4b-2c5ab15c29fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:56.168093 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3caada-a42e-4461-9b4b-2c5ab15c29fe admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.168442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3caada-a42e-4461-9b4b-2c5ab15c29fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.168779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3caada-a42e-4461-9b4b-2c5ab15c29fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.169557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3caada-a42e-4461-9b4b-2c5ab15c29fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:10:56.169928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3caada-a42e-4461-9b4b-2c5ab15c29fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:56.171691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3caada-a42e-4461-9b4b-2c5ab15c29fe admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:56.174773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d03409f1-8c20-4365-ac8d-485058d1d5d7 None None] MFA Rules not processed for user `d92fdaec9af8468ea2fbae6e4b073f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:56.176437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:56.176768 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d03409f1-8c20-4365-ac8d-485058d1d5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:56.194807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1019/2063] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:10:56.197806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3caada-a42e-4461-9b4b-2c5ab15c29fe admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:56.199620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fe3caada-a42e-4461-9b4b-2c5ab15c29fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:56.299170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3caada-a42e-4461-9b4b-2c5ab15c29fe admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:56.309917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97108843-f17b-4754-bfba-25291a78580c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:56.309917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108843-f17b-4754-bfba-25291a78580c service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.309917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108843-f17b-4754-bfba-25291a78580c service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.309917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97108843-f17b-4754-bfba-25291a78580c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.310468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1045/2064] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:56.311368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03409f1-8c20-4365-ac8d-485058d1d5d7 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:56.333618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03409f1-8c20-4365-ac8d-485058d1d5d7 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:56.339661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364a0b1-e679-417e-a69a-033424e61503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:56.340365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364a0b1-e679-417e-a69a-033424e61503 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.340754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364a0b1-e679-417e-a69a-033424e61503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.341134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364a0b1-e679-417e-a69a-033424e61503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.341939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364a0b1-e679-417e-a69a-033424e61503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:56.344040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364a0b1-e679-417e-a69a-033424e61503 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:56.388216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97108843-f17b-4754-bfba-25291a78580c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:56.389389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97108843-f17b-4754-bfba-25291a78580c service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:56.394558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1046/2065] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:10:56 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:10:56.398427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364a0b1-e679-417e-a69a-033424e61503 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:56.404447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1020/2066] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:56.437620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:56.552923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364a0b1-e679-417e-a69a-033424e61503 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:56.566267 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815eea4-db55-4751-bc28-cd1140040efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:56.566987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815eea4-db55-4751-bc28-cd1140040efb admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.567275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815eea4-db55-4751-bc28-cd1140040efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.567553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815eea4-db55-4751-bc28-cd1140040efb admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.568207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815eea4-db55-4751-bc28-cd1140040efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:56.570196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815eea4-db55-4751-bc28-cd1140040efb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:56.620710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1047/2067] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:10:56 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:10:56.623253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97108843-f17b-4754-bfba-25291a78580c service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:56.639677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97108843-f17b-4754-bfba-25291a78580c service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:56.648488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815eea4-db55-4751-bc28-cd1140040efb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:56.650872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a815eea4-db55-4751-bc28-cd1140040efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:56.652803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a955e-5f2f-47ee-9dbb-d5dc1de4576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:56.653504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a955e-5f2f-47ee-9dbb-d5dc1de4576a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.653933 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a955e-5f2f-47ee-9dbb-d5dc1de4576a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.654204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a955e-5f2f-47ee-9dbb-d5dc1de4576a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.656977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a955e-5f2f-47ee-9dbb-d5dc1de4576a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:56.662185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a955e-5f2f-47ee-9dbb-d5dc1de4576a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:56.700821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1021/2068] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:56.709348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a955e-5f2f-47ee-9dbb-d5dc1de4576a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:56.744347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a955e-5f2f-47ee-9dbb-d5dc1de4576a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:56.759706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aefbd8-8bbe-4ac3-89b6-e0172bb45d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:56.760357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aefbd8-8bbe-4ac3-89b6-e0172bb45d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.761058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aefbd8-8bbe-4ac3-89b6-e0172bb45d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.761058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aefbd8-8bbe-4ac3-89b6-e0172bb45d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.765504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aefbd8-8bbe-4ac3-89b6-e0172bb45d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:56.769531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aefbd8-8bbe-4ac3-89b6-e0172bb45d2b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:56.796414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1022/2069] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:10:56.800976 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aefbd8-8bbe-4ac3-89b6-e0172bb45d2b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:56.802279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815eea4-db55-4751-bc28-cd1140040efb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:56.826062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aefbd8-8bbe-4ac3-89b6-e0172bb45d2b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:56.837219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed72a79-79ce-4b4f-85ee-39edc5062802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:56.838567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72a79-79ce-4b4f-85ee-39edc5062802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.838880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72a79-79ce-4b4f-85ee-39edc5062802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.840873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72a79-79ce-4b4f-85ee-39edc5062802 admin admin] PATH_INFO: `/v3/projects/094c0f15c1bc424ea22f3786c91fffc7/users/c1ab7333e46a4f7bb37b79642df80bc1/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.846822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9b762-5d28-4ac6-bba7-b7dd5705c204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:56.848312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9b762-5d28-4ac6-bba7-b7dd5705c204 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.850831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9b762-5d28-4ac6-bba7-b7dd5705c204 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.850831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9b762-5d28-4ac6-bba7-b7dd5705c204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:56.890580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed72a79-79ce-4b4f-85ee-39edc5062802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094c0f15c1bc424ea22f3786c91fffc7, user_id=c1ab7333e46a4f7bb37b79642df80bc1, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:56.897234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed72a79-79ce-4b4f-85ee-39edc5062802 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:56.932542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1023/2070] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:10:56 2022] PUT /identity/v3/projects/094c0f15c1bc424ea22f3786c91fffc7/users/c1ab7333e46a4f7bb37b79642df80bc1/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:56.949114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b619a8-e6af-4ebe-82ef-eb3f2c2b8750 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:56.950606 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b619a8-e6af-4ebe-82ef-eb3f2c2b8750 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:56.951653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b619a8-e6af-4ebe-82ef-eb3f2c2b8750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:57.018337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b3b619a8-e6af-4ebe-82ef-eb3f2c2b8750 None None] MFA Rules not processed for user `c1ab7333e46a4f7bb37b79642df80bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:57.019725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b3b619a8-e6af-4ebe-82ef-eb3f2c2b8750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:57.024389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9b762-5d28-4ac6-bba7-b7dd5705c204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:57.028055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9b762-5d28-4ac6-bba7-b7dd5705c204 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:57.068912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1048/2071] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:57.179560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:57.206029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1024/2072] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:57.212883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9b762-5d28-4ac6-bba7-b7dd5705c204 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:57.214748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-84d9b762-5d28-4ac6-bba7-b7dd5705c204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:57.329713 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:57.388888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9b762-5d28-4ac6-bba7-b7dd5705c204 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:57.455934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3fb1d-7e6e-46f0-ba70-df5820d986b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c746178628e4df5961982268e642ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:57.456554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3fb1d-7e6e-46f0-ba70-df5820d986b1 service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:57.456868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3fb1d-7e6e-46f0-ba70-df5820d986b1 service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:57.457210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3fb1d-7e6e-46f0-ba70-df5820d986b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:57.467801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3fb1d-7e6e-46f0-ba70-df5820d986b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:57.469779 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3fb1d-7e6e-46f0-ba70-df5820d986b1 service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:57.481686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1049/2073] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:10:57.786550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b619a8-e6af-4ebe-82ef-eb3f2c2b8750 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:57.867005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b619a8-e6af-4ebe-82ef-eb3f2c2b8750 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:57.874638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:57.875620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:57.875911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:57.876213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] PATH_INFO: `/v3/users/c734355102894dc1a200c7f32e984f1a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:57.877539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c734355102894dc1a200c7f32e984f1a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:57.879959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:57.969437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c734355102894dc1a200c7f32e984f1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:57.997337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c734355102894dc1a200c7f32e984f1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:57.999943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c734355102894dc1a200c7f32e984f1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:58.017403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c734355102894dc1a200c7f32e984f1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:58.018167 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c734355102894dc1a200c7f32e984f1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:58.070689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1025/2074] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:57 2022] DELETE /identity/v3/users/c734355102894dc1a200c7f32e984f1a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:58.075659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d2d1-585a-4cae-9fb6-c78eaecbc336 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:58.076217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d2d1-585a-4cae-9fb6-c78eaecbc336 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:58.076217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d2d1-585a-4cae-9fb6-c78eaecbc336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:58.121589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fbe8d2d1-585a-4cae-9fb6-c78eaecbc336 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:10:58.125632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fbe8d2d1-585a-4cae-9fb6-c78eaecbc336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:58.297086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1050/2075] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:10:58.297263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:58.298701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:58.474158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43975dc9-c57a-495d-b81d-bcdf9a5a73a1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:58.482664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cbd56-f298-4326-9f89-2ab55b2396fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:58.493078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cbd56-f298-4326-9f89-2ab55b2396fd service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:58.493078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cbd56-f298-4326-9f89-2ab55b2396fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:58.493078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cbd56-f298-4326-9f89-2ab55b2396fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:58.521118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cbd56-f298-4326-9f89-2ab55b2396fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:58.521118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841cbd56-f298-4326-9f89-2ab55b2396fd service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:58.536180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1026/2076] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:10:59.007476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d2d1-585a-4cae-9fb6-c78eaecbc336 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:59.008821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fbe8d2d1-585a-4cae-9fb6-c78eaecbc336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:59.021482 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d2d1-585a-4cae-9fb6-c78eaecbc336 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:59.032125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:59.032803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:59.033211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:59.033457 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] PATH_INFO: `/v3/projects/164d6a7d05d8472fbf77c9cdc9816de4` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:59.035106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=164d6a7d05d8472fbf77c9cdc9816de4)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:59.037069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:59.132049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '164d6a7d05d8472fbf77c9cdc9816de4', 'request_id': 'req-a48cc63d-8ad7-4c09-97db-4ce00c89d294'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.147458 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '164d6a7d05d8472fbf77c9cdc9816de4', 'request_id': 'req-a48cc63d-8ad7-4c09-97db-4ce00c89d294'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.172783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '164d6a7d05d8472fbf77c9cdc9816de4', 'request_id': 'req-a48cc63d-8ad7-4c09-97db-4ce00c89d294'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.203355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] The token cache is being invalidate because project 164d6a7d05d8472fbf77c9cdc9816de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:10:59.203767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.204736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.206667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1051/2077] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:59 2022] DELETE /identity/v3/projects/164d6a7d05d8472fbf77c9cdc9816de4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:59.211414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cbd56-f298-4326-9f89-2ab55b2396fd service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:59.227984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cbd56-f298-4326-9f89-2ab55b2396fd service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:59.256100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:59.338213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:59.338880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:59.339316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:59.339831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] PATH_INFO: `/v3/users/d92fdaec9af8468ea2fbae6e4b073f8d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:59.341688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d92fdaec9af8468ea2fbae6e4b073f8d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:59.345419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:59.443230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92fdaec9af8468ea2fbae6e4b073f8d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.455998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92fdaec9af8468ea2fbae6e4b073f8d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.457097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92fdaec9af8468ea2fbae6e4b073f8d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.468693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92fdaec9af8468ea2fbae6e4b073f8d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.469732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-856d49d8-f662-4a1d-9201-3eb0afddbd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92fdaec9af8468ea2fbae6e4b073f8d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.493890 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1027/2078] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:10:59 2022] DELETE /identity/v3/users/d92fdaec9af8468ea2fbae6e4b073f8d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:10:59.842627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:10:59.844260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:10:59.859475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cc63d-8ad7-4c09-97db-4ce00c89d294 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:10:59.879275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:10:59.923920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:10:59.924568 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:10:59.924848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:10:59.925165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] PATH_INFO: `/v3/projects/e230248bb0ba42578a68352d94b0b924` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:10:59.926438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e230248bb0ba42578a68352d94b0b924)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:10:59.928433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:10:59.982775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e230248bb0ba42578a68352d94b0b924', 'request_id': 'req-4bf3c8ae-761f-4e79-a640-ad856fa54164'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.989489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e230248bb0ba42578a68352d94b0b924', 'request_id': 'req-4bf3c8ae-761f-4e79-a640-ad856fa54164'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:10:59.999663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e230248bb0ba42578a68352d94b0b924', 'request_id': 'req-4bf3c8ae-761f-4e79-a640-ad856fa54164'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:00.011555 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] The token cache is being invalidate because project e230248bb0ba42578a68352d94b0b924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:00.011877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:00.012519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4bf3c8ae-761f-4e79-a640-ad856fa54164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:00.014077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1052/2079] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:10:59 2022] DELETE /identity/v3/projects/e230248bb0ba42578a68352d94b0b924 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:00.019821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e651-e0db-4471-bb64-0f5aa114e509 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.020109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e651-e0db-4471-bb64-0f5aa114e509 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.020387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e651-e0db-4471-bb64-0f5aa114e509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.040564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ef94e651-e0db-4471-bb64-0f5aa114e509 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:00.041805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef94e651-e0db-4471-bb64-0f5aa114e509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:00.101113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1028/2080] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:00.110260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39047-b201-49b3-91f0-e56021d28f57 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.110553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39047-b201-49b3-91f0-e56021d28f57 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.110829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df39047-b201-49b3-91f0-e56021d28f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.132392 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6df39047-b201-49b3-91f0-e56021d28f57 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:00.133647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6df39047-b201-49b3-91f0-e56021d28f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:00.143661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1053/2081] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:00.148176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94e651-e0db-4471-bb64-0f5aa114e509 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:00.158416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94e651-e0db-4471-bb64-0f5aa114e509 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:00.163789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9a1ef-07bc-4862-a6ac-00eee306f983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:00.164394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9a1ef-07bc-4862-a6ac-00eee306f983 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.164678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9a1ef-07bc-4862-a6ac-00eee306f983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.164972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9a1ef-07bc-4862-a6ac-00eee306f983 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.165653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9a1ef-07bc-4862-a6ac-00eee306f983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:00.165957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9a1ef-07bc-4862-a6ac-00eee306f983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:00.167564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9a1ef-07bc-4862-a6ac-00eee306f983 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:00.179522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1029/2082] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:11:00.184288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df39047-b201-49b3-91f0-e56021d28f57 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:00.196319 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df39047-b201-49b3-91f0-e56021d28f57 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:00.203292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c98aeb-50fa-4367-bbf3-4ddc9f982225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:00.203989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c98aeb-50fa-4367-bbf3-4ddc9f982225 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.204413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c98aeb-50fa-4367-bbf3-4ddc9f982225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.204678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c98aeb-50fa-4367-bbf3-4ddc9f982225 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.205370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c98aeb-50fa-4367-bbf3-4ddc9f982225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:00.207773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c98aeb-50fa-4367-bbf3-4ddc9f982225 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:00.239256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1054/2083] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:00 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:00.243872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9a1ef-07bc-4862-a6ac-00eee306f983 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:00.254447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9a1ef-07bc-4862-a6ac-00eee306f983 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:00.274421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:00.317242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe0396-e284-4f44-8355-7baf0154eb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:00.317895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe0396-e284-4f44-8355-7baf0154eb39 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.318188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe0396-e284-4f44-8355-7baf0154eb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.318447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe0396-e284-4f44-8355-7baf0154eb39 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.319085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe0396-e284-4f44-8355-7baf0154eb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:00.321007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe0396-e284-4f44-8355-7baf0154eb39 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:00.349509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1030/2084] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:00 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:00.353625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c98aeb-50fa-4367-bbf3-4ddc9f982225 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:00.366201 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c98aeb-50fa-4367-bbf3-4ddc9f982225 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:00.375967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad502d2-3d60-4268-afeb-648abf0947dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:00.376617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad502d2-3d60-4268-afeb-648abf0947dd admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.376909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad502d2-3d60-4268-afeb-648abf0947dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.377227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad502d2-3d60-4268-afeb-648abf0947dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.377895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad502d2-3d60-4268-afeb-648abf0947dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:00.379591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad502d2-3d60-4268-afeb-648abf0947dd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:00.392298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1055/2085] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:00.396491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe0396-e284-4f44-8355-7baf0154eb39 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:00.407701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe0396-e284-4f44-8355-7baf0154eb39 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:00.413264 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab295f0-6fb0-47ba-acef-4140a48709c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:00.413799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab295f0-6fb0-47ba-acef-4140a48709c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.414079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab295f0-6fb0-47ba-acef-4140a48709c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.425186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab295f0-6fb0-47ba-acef-4140a48709c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.425186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab295f0-6fb0-47ba-acef-4140a48709c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:00.425186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab295f0-6fb0-47ba-acef-4140a48709c9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:00.435755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1031/2086] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:00.436092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad502d2-3d60-4268-afeb-648abf0947dd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:00.448240 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad502d2-3d60-4268-afeb-648abf0947dd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:00.458349 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d877e-4892-4061-8d59-c9875ef5edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:00.459562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d877e-4892-4061-8d59-c9875ef5edf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.460097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d877e-4892-4061-8d59-c9875ef5edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.460236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d877e-4892-4061-8d59-c9875ef5edf3 admin admin] PATH_INFO: `/v3/projects/0679969b94ee430ba80c1bccce4cb79e/users/ddd5a590ffba43d9bd5455f4a092c9ea/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.476003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d877e-4892-4061-8d59-c9875ef5edf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0679969b94ee430ba80c1bccce4cb79e, user_id=ddd5a590ffba43d9bd5455f4a092c9ea, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:00.487087 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d877e-4892-4061-8d59-c9875ef5edf3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:00.500628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1056/2087] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:00 2022] PUT /identity/v3/projects/0679969b94ee430ba80c1bccce4cb79e/users/ddd5a590ffba43d9bd5455f4a092c9ea/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:00.512112 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50089fb3-e33c-4e31-b796-702cae4883a6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.512571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50089fb3-e33c-4e31-b796-702cae4883a6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.513174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50089fb3-e33c-4e31-b796-702cae4883a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.546377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-50089fb3-e33c-4e31-b796-702cae4883a6 None None] MFA Rules not processed for user `ddd5a590ffba43d9bd5455f4a092c9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:00.547769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-50089fb3-e33c-4e31-b796-702cae4883a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:00.627874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1032/2088] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:00.632862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d877e-4892-4061-8d59-c9875ef5edf3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:00.704834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:00.723886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d877e-4892-4061-8d59-c9875ef5edf3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:00.730009 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc82e-0465-417e-89ba-c9dde4915913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:00.730775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc82e-0465-417e-89ba-c9dde4915913 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.731524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc82e-0465-417e-89ba-c9dde4915913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.731524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc82e-0465-417e-89ba-c9dde4915913 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.732301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fc82e-0465-417e-89ba-c9dde4915913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:00.734972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fc82e-0465-417e-89ba-c9dde4915913 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:00.789987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1057/2089] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:00 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:00.794004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50089fb3-e33c-4e31-b796-702cae4883a6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:00.820694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50089fb3-e33c-4e31-b796-702cae4883a6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:00.958046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e204d51-ac6a-47c3-811d-cbdd259fc661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:00.958939 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e204d51-ac6a-47c3-811d-cbdd259fc661 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:00.959817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e204d51-ac6a-47c3-811d-cbdd259fc661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:00.959817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e204d51-ac6a-47c3-811d-cbdd259fc661 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:00.960464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e204d51-ac6a-47c3-811d-cbdd259fc661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:00.962647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e204d51-ac6a-47c3-811d-cbdd259fc661 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:00.988749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1033/2090] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:00 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:00.992795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc82e-0465-417e-89ba-c9dde4915913 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.004872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc82e-0465-417e-89ba-c9dde4915913 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:01.017300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36d1b5-acff-4154-94e2-2c4fef6ca9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:01.018237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d1b5-acff-4154-94e2-2c4fef6ca9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.018534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d1b5-acff-4154-94e2-2c4fef6ca9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.018808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d1b5-acff-4154-94e2-2c4fef6ca9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.019918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36d1b5-acff-4154-94e2-2c4fef6ca9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:01.021586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36d1b5-acff-4154-94e2-2c4fef6ca9f7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:01.032970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1058/2091] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:11:01.038226 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e204d51-ac6a-47c3-811d-cbdd259fc661 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.049750 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e204d51-ac6a-47c3-811d-cbdd259fc661 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:01.054679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0576cc-2093-4301-941b-5de10b365d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:01.055298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0576cc-2093-4301-941b-5de10b365d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.055600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0576cc-2093-4301-941b-5de10b365d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.055889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0576cc-2093-4301-941b-5de10b365d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.056588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0576cc-2093-4301-941b-5de10b365d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:01.058797 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0576cc-2093-4301-941b-5de10b365d87 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:01.069764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1034/2092] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:01.074198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36d1b5-acff-4154-94e2-2c4fef6ca9f7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.084416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36d1b5-acff-4154-94e2-2c4fef6ca9f7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:01.088969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513a45c-0afc-43e8-974d-da93eab141c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:01.089660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513a45c-0afc-43e8-974d-da93eab141c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.089936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513a45c-0afc-43e8-974d-da93eab141c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.090228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513a45c-0afc-43e8-974d-da93eab141c1 admin admin] PATH_INFO: `/v3/projects/90a0bed47b544e86b45f7acfb65fe0e1/users/d4cbd1a588b4474ea62ea069238915af/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.105498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513a45c-0afc-43e8-974d-da93eab141c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a0bed47b544e86b45f7acfb65fe0e1, user_id=d4cbd1a588b4474ea62ea069238915af, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:01.108170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513a45c-0afc-43e8-974d-da93eab141c1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:01.123170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1059/2093] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:01 2022] PUT /identity/v3/projects/90a0bed47b544e86b45f7acfb65fe0e1/users/d4cbd1a588b4474ea62ea069238915af/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:01.135213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62932736-44ea-4580-b87a-5b3ff6ad07f0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.135517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62932736-44ea-4580-b87a-5b3ff6ad07f0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.135785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62932736-44ea-4580-b87a-5b3ff6ad07f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.156860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:01.166925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-62932736-44ea-4580-b87a-5b3ff6ad07f0 None None] MFA Rules not processed for user `d4cbd1a588b4474ea62ea069238915af`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:01.168611 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-62932736-44ea-4580-b87a-5b3ff6ad07f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:01.239610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1035/2094] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:01.244674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513a45c-0afc-43e8-974d-da93eab141c1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.313959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513a45c-0afc-43e8-974d-da93eab141c1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:01.318932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab142e-327e-40d2-8df4-d25606d58bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:01.319588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab142e-327e-40d2-8df4-d25606d58bde admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.319847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab142e-327e-40d2-8df4-d25606d58bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.320125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab142e-327e-40d2-8df4-d25606d58bde admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.320767 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab142e-327e-40d2-8df4-d25606d58bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:01.322741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab142e-327e-40d2-8df4-d25606d58bde admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:01.351970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1060/2095] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:01 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:01.356976 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62932736-44ea-4580-b87a-5b3ff6ad07f0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.368016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62932736-44ea-4580-b87a-5b3ff6ad07f0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:01.425879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857415c6-e57f-43f9-84e8-bee2b5510049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:01.426407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857415c6-e57f-43f9-84e8-bee2b5510049 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.426683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857415c6-e57f-43f9-84e8-bee2b5510049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.426962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857415c6-e57f-43f9-84e8-bee2b5510049 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.427645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857415c6-e57f-43f9-84e8-bee2b5510049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:01.429614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857415c6-e57f-43f9-84e8-bee2b5510049 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:01.453324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1036/2096] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:01 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:01.457704 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab142e-327e-40d2-8df4-d25606d58bde admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.468277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab142e-327e-40d2-8df4-d25606d58bde admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:01.473174 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73303fb1-b150-4256-942d-03662c0cbe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:01.473791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73303fb1-b150-4256-942d-03662c0cbe48 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.474086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73303fb1-b150-4256-942d-03662c0cbe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.474348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73303fb1-b150-4256-942d-03662c0cbe48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.474995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73303fb1-b150-4256-942d-03662c0cbe48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:01.476649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73303fb1-b150-4256-942d-03662c0cbe48 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:01.491705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1061/2097] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:01.493137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857415c6-e57f-43f9-84e8-bee2b5510049 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.504384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857415c6-e57f-43f9-84e8-bee2b5510049 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:01.509973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ce6cf-1ec1-46ca-bf07-47adf7bcb6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:01.510754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ce6cf-1ec1-46ca-bf07-47adf7bcb6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.511035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ce6cf-1ec1-46ca-bf07-47adf7bcb6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.511308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ce6cf-1ec1-46ca-bf07-47adf7bcb6ce admin admin] PATH_INFO: `/v3/projects/0012d250187b4d72ad8ebc0bea9ba680/users/47f086bec9e3487fa185a5519123fa92/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.526556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ce6cf-1ec1-46ca-bf07-47adf7bcb6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=0012d250187b4d72ad8ebc0bea9ba680, user_id=47f086bec9e3487fa185a5519123fa92, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:01.529252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ce6cf-1ec1-46ca-bf07-47adf7bcb6ce admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:01.548760 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1037/2098] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:01 2022] PUT /identity/v3/projects/0012d250187b4d72ad8ebc0bea9ba680/users/47f086bec9e3487fa185a5519123fa92/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:01.552894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73303fb1-b150-4256-942d-03662c0cbe48 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.563339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73303fb1-b150-4256-942d-03662c0cbe48 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:01.631816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e6045-f680-426d-b96b-e602bb77fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:01.632445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6045-f680-426d-b96b-e602bb77fcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.632730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6045-f680-426d-b96b-e602bb77fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.633006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e6045-f680-426d-b96b-e602bb77fcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.633703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e6045-f680-426d-b96b-e602bb77fcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:01.635297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e6045-f680-426d-b96b-e602bb77fcc6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:01.645316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1062/2099] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:01.649707 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ce6cf-1ec1-46ca-bf07-47adf7bcb6ce admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.660584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ce6cf-1ec1-46ca-bf07-47adf7bcb6ce admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:01.666166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1ea66-4209-4102-98cd-ab4af4be09e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:01.666875 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ea66-4209-4102-98cd-ab4af4be09e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.667154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ea66-4209-4102-98cd-ab4af4be09e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.667452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1ea66-4209-4102-98cd-ab4af4be09e9 admin admin] PATH_INFO: `/v3/projects/0012d250187b4d72ad8ebc0bea9ba680/users/47f086bec9e3487fa185a5519123fa92/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.669645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1ea66-4209-4102-98cd-ab4af4be09e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0012d250187b4d72ad8ebc0bea9ba680, user_id=47f086bec9e3487fa185a5519123fa92, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:01.672585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1ea66-4209-4102-98cd-ab4af4be09e9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:01.684993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1038/2100] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:01 2022] PUT /identity/v3/projects/0012d250187b4d72ad8ebc0bea9ba680/users/47f086bec9e3487fa185a5519123fa92/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:01.695306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc1f19-99a9-454c-8010-bb915dac0b20 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.695776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc1f19-99a9-454c-8010-bb915dac0b20 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.697188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc1f19-99a9-454c-8010-bb915dac0b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.706272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:01.737686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dbfc1f19-99a9-454c-8010-bb915dac0b20 None None] MFA Rules not processed for user `47f086bec9e3487fa185a5519123fa92`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:01.739010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dbfc1f19-99a9-454c-8010-bb915dac0b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:01.826829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1063/2101] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:01.842735 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1ea66-4209-4102-98cd-ab4af4be09e9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.849454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bee1ea66-4209-4102-98cd-ab4af4be09e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:01.906708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1ea66-4209-4102-98cd-ab4af4be09e9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:01.911508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0526382-fc81-477c-a107-2ba3f1106179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:01.912136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0526382-fc81-477c-a107-2ba3f1106179 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:01.912413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0526382-fc81-477c-a107-2ba3f1106179 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:01.912718 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0526382-fc81-477c-a107-2ba3f1106179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:01.917461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:01.988370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0526382-fc81-477c-a107-2ba3f1106179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:01.989638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc1f19-99a9-454c-8010-bb915dac0b20 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:01.990572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0526382-fc81-477c-a107-2ba3f1106179 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:01.991040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dbfc1f19-99a9-454c-8010-bb915dac0b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:02.001127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1039/2102] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:02.069465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc1f19-99a9-454c-8010-bb915dac0b20 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:02.077024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:02.084417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:02.085364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:02.085651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] PATH_INFO: `/v3/users/153f5595c44245c5a1659915f0a7838f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:02.087203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=153f5595c44245c5a1659915f0a7838f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:02.089656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:02.177179 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153f5595c44245c5a1659915f0a7838f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:02.182404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153f5595c44245c5a1659915f0a7838f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:02.201918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153f5595c44245c5a1659915f0a7838f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:02.211827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153f5595c44245c5a1659915f0a7838f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:02.212684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153f5595c44245c5a1659915f0a7838f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:02.252092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1064/2103] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:01 2022] DELETE /identity/v3/users/153f5595c44245c5a1659915f0a7838f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:02.257080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363716b4-922b-4b92-85ea-dca0ad581e7e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:02.257353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363716b4-922b-4b92-85ea-dca0ad581e7e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:02.257623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363716b4-922b-4b92-85ea-dca0ad581e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:02.278528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-363716b4-922b-4b92-85ea-dca0ad581e7e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:02.280231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-363716b4-922b-4b92-85ea-dca0ad581e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:02.376443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1040/2104] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:02.388163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:02.389890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:02.401374 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:02.478511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe46b44-8665-4a21-8b5a-42646f527ef1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:02.483461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b97b0-b437-4d64-b1be-cec87ef1eedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:02.484136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b97b0-b437-4d64-b1be-cec87ef1eedc service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:02.484431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b97b0-b437-4d64-b1be-cec87ef1eedc service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:02.484715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b97b0-b437-4d64-b1be-cec87ef1eedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:02.495940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b97b0-b437-4d64-b1be-cec87ef1eedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:02.497463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b97b0-b437-4d64-b1be-cec87ef1eedc service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:02.508560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1065/2105] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:02.811651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363716b4-922b-4b92-85ea-dca0ad581e7e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:02.813711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-363716b4-922b-4b92-85ea-dca0ad581e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:02.830138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363716b4-922b-4b92-85ea-dca0ad581e7e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:02.836751 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:02.838534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:02.838930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:02.839392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] PATH_INFO: `/v3/projects/aac08e9b11074775bf01397fb07aebc2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:02.840988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac08e9b11074775bf01397fb07aebc2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:02.844065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:02.932798 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac08e9b11074775bf01397fb07aebc2', 'request_id': 'req-812e69a5-b945-4d4b-8460-7b5abd18ca92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:02.939258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac08e9b11074775bf01397fb07aebc2', 'request_id': 'req-812e69a5-b945-4d4b-8460-7b5abd18ca92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:02.949813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac08e9b11074775bf01397fb07aebc2', 'request_id': 'req-812e69a5-b945-4d4b-8460-7b5abd18ca92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:02.963613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] The token cache is being invalidate because project aac08e9b11074775bf01397fb07aebc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:02.963895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:02.964567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:02.966248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1041/2106] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:02 2022] DELETE /identity/v3/projects/aac08e9b11074775bf01397fb07aebc2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:02.970567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b97b0-b437-4d64-b1be-cec87ef1eedc service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:02.984126 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b97b0-b437-4d64-b1be-cec87ef1eedc service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:03.072711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:03.073549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:03.073830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:03.074085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] PATH_INFO: `/v3/users/64ca7ace556a4c0ab0647015a9772eb8` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:03.075340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ca7ace556a4c0ab0647015a9772eb8)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:03.077590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:03.177650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ca7ace556a4c0ab0647015a9772eb8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:03.179295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ca7ace556a4c0ab0647015a9772eb8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:03.220667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ca7ace556a4c0ab0647015a9772eb8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:03.236951 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ca7ace556a4c0ab0647015a9772eb8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:03.238152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ca7ace556a4c0ab0647015a9772eb8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:03.267030 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1066/2107] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:02 2022] DELETE /identity/v3/users/64ca7ace556a4c0ab0647015a9772eb8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:03.709645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:03.711124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:03.759761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:03.799685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e69a5-b945-4d4b-8460-7b5abd18ca92 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:03.866366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38391b35-d150-49b6-8f4f-8f264b37c056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:03.868014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391b35-d150-49b6-8f4f-8f264b37c056 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:03.868014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391b35-d150-49b6-8f4f-8f264b37c056 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:03.868014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38391b35-d150-49b6-8f4f-8f264b37c056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:03.870497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-38391b35-d150-49b6-8f4f-8f264b37c056 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:03.947987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38391b35-d150-49b6-8f4f-8f264b37c056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:03.949676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38391b35-d150-49b6-8f4f-8f264b37c056 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:03.959438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1042/2108] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:03.961444 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:03.963445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:04.029148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:04.078465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709722a-6c4f-47a7-af44-f92a83301766 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:04.084510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:04.085200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:04.085483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:04.085756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] PATH_INFO: `/v3/projects/42697aee449f4ba49585a85704444772` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:04.087013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42697aee449f4ba49585a85704444772)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:04.088847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:04.165256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42697aee449f4ba49585a85704444772', 'request_id': 'req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:04.173004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42697aee449f4ba49585a85704444772', 'request_id': 'req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:04.182799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42697aee449f4ba49585a85704444772', 'request_id': 'req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:04.199431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] The token cache is being invalidate because project 42697aee449f4ba49585a85704444772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:04.203154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:04.203154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-87e6cdda-43ed-4e3a-8f71-1d31434a1ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:04.205136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1067/2109] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:03 2022] DELETE /identity/v3/projects/42697aee449f4ba49585a85704444772 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:04.208841 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f89168-bba4-439c-a66a-3ccc64740701 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:04.209372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f89168-bba4-439c-a66a-3ccc64740701 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:04.209818 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f89168-bba4-439c-a66a-3ccc64740701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:04.230597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-07f89168-bba4-439c-a66a-3ccc64740701 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:04.231783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-07f89168-bba4-439c-a66a-3ccc64740701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:04.310835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1043/2110] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:04.313093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16671a1d-1b21-4cf1-b22d-800803f7f90b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:04.313972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16671a1d-1b21-4cf1-b22d-800803f7f90b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:04.314485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16671a1d-1b21-4cf1-b22d-800803f7f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:04.353373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-16671a1d-1b21-4cf1-b22d-800803f7f90b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:04.355035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-16671a1d-1b21-4cf1-b22d-800803f7f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:04.368088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1068/2111] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:04.374104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f89168-bba4-439c-a66a-3ccc64740701 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:04.397016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f89168-bba4-439c-a66a-3ccc64740701 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:04.406341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c89141-c1a0-4d07-913f-4cf557f59593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:04.407683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c89141-c1a0-4d07-913f-4cf557f59593 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:04.407683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c89141-c1a0-4d07-913f-4cf557f59593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:04.407835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c89141-c1a0-4d07-913f-4cf557f59593 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:04.409509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c89141-c1a0-4d07-913f-4cf557f59593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:04.430375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c89141-c1a0-4d07-913f-4cf557f59593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:04.435031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c89141-c1a0-4d07-913f-4cf557f59593 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:04.499778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1044/2112] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:11:04.504645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16671a1d-1b21-4cf1-b22d-800803f7f90b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:04.517785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16671a1d-1b21-4cf1-b22d-800803f7f90b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:04.523852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feb2c3-112b-4340-84a0-0f9ad5dbae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:04.524898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb2c3-112b-4340-84a0-0f9ad5dbae3b admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:04.525586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb2c3-112b-4340-84a0-0f9ad5dbae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:04.526133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feb2c3-112b-4340-84a0-0f9ad5dbae3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:04.527434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feb2c3-112b-4340-84a0-0f9ad5dbae3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:04.530839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feb2c3-112b-4340-84a0-0f9ad5dbae3b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:04.586031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1069/2113] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:04 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:04.586995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c89141-c1a0-4d07-913f-4cf557f59593 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:04.598176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c89141-c1a0-4d07-913f-4cf557f59593 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:04.665386 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:04.741576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed1760-9982-43e3-83c5-5a36c9c72573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:04.742205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed1760-9982-43e3-83c5-5a36c9c72573 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:04.742616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed1760-9982-43e3-83c5-5a36c9c72573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:04.743212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed1760-9982-43e3-83c5-5a36c9c72573 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:04.744530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed1760-9982-43e3-83c5-5a36c9c72573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:04.746597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed1760-9982-43e3-83c5-5a36c9c72573 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:04.824225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1045/2114] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:04 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:11:04.825957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feb2c3-112b-4340-84a0-0f9ad5dbae3b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:04.858389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feb2c3-112b-4340-84a0-0f9ad5dbae3b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:04.868765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b028db4-a6f0-4bb5-8d3f-a27ce6334551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:04.869858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b028db4-a6f0-4bb5-8d3f-a27ce6334551 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:04.870934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b028db4-a6f0-4bb5-8d3f-a27ce6334551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:04.871106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b028db4-a6f0-4bb5-8d3f-a27ce6334551 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:04.873701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b028db4-a6f0-4bb5-8d3f-a27ce6334551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:04.879234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b028db4-a6f0-4bb5-8d3f-a27ce6334551 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:04.904666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1070/2115] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:04.905845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed1760-9982-43e3-83c5-5a36c9c72573 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:04.920398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed1760-9982-43e3-83c5-5a36c9c72573 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:04.930930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530890a-0ce4-43ab-b29d-ceb057db6e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:04.931561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530890a-0ce4-43ab-b29d-ceb057db6e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:04.931843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530890a-0ce4-43ab-b29d-ceb057db6e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:04.932675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530890a-0ce4-43ab-b29d-ceb057db6e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:04.933478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530890a-0ce4-43ab-b29d-ceb057db6e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:04.936883 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530890a-0ce4-43ab-b29d-ceb057db6e75 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:04.955222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1046/2116] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:11:04.961443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b028db4-a6f0-4bb5-8d3f-a27ce6334551 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:04.993580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b028db4-a6f0-4bb5-8d3f-a27ce6334551 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:05.018612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84e1c3-73b3-4f24-8c93-08ff509dfeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:05.021510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84e1c3-73b3-4f24-8c93-08ff509dfeaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:05.021801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84e1c3-73b3-4f24-8c93-08ff509dfeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:05.022079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84e1c3-73b3-4f24-8c93-08ff509dfeaf admin admin] PATH_INFO: `/v3/projects/6327080a250048f8a386d21288d735bc/users/fe6c2b9ae4a84e658e24eb22e764ebbb/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:05.053785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530890a-0ce4-43ab-b29d-ceb057db6e75 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:05.055854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4530890a-0ce4-43ab-b29d-ceb057db6e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:05.062278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84e1c3-73b3-4f24-8c93-08ff509dfeaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6327080a250048f8a386d21288d735bc, user_id=fe6c2b9ae4a84e658e24eb22e764ebbb, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:05.070223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84e1c3-73b3-4f24-8c93-08ff509dfeaf admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:05.105476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1071/2117] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:04 2022] PUT /identity/v3/projects/6327080a250048f8a386d21288d735bc/users/fe6c2b9ae4a84e658e24eb22e764ebbb/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:05.118840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bea6-1cb6-42f4-8fd3-00bd79fab8e4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:05.119163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bea6-1cb6-42f4-8fd3-00bd79fab8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:05.119406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712bea6-1cb6-42f4-8fd3-00bd79fab8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:05.152626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2712bea6-1cb6-42f4-8fd3-00bd79fab8e4 None None] MFA Rules not processed for user `fe6c2b9ae4a84e658e24eb22e764ebbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:05.153968 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2712bea6-1cb6-42f4-8fd3-00bd79fab8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:05.170647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530890a-0ce4-43ab-b29d-ceb057db6e75 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:05.219890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:05.250734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1072/2118] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:11:05.255574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712bea6-1cb6-42f4-8fd3-00bd79fab8e4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:05.259932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6042e-4dd5-4332-818a-93000df3b256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:05.260577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6042e-4dd5-4332-818a-93000df3b256 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:05.260857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6042e-4dd5-4332-818a-93000df3b256 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:05.261156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6042e-4dd5-4332-818a-93000df3b256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:05.266581 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b7a6042e-4dd5-4332-818a-93000df3b256 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:05.343250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712bea6-1cb6-42f4-8fd3-00bd79fab8e4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:05.348300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e023247-e476-479c-8b77-46950e56e491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:05.348936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e023247-e476-479c-8b77-46950e56e491 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:05.349258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e023247-e476-479c-8b77-46950e56e491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:05.349537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e023247-e476-479c-8b77-46950e56e491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:05.350183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e023247-e476-479c-8b77-46950e56e491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:05.352127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e023247-e476-479c-8b77-46950e56e491 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:05.365866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6042e-4dd5-4332-818a-93000df3b256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:05.368015 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6042e-4dd5-4332-818a-93000df3b256 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:05.404932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1073/2119] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:05 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:05.408375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1047/2120] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:05.410042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e023247-e476-479c-8b77-46950e56e491 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:05.504175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e023247-e476-479c-8b77-46950e56e491 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:05.509729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b1db0-a784-45f5-9009-e61f3e1ac3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:05.510348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1db0-a784-45f5-9009-e61f3e1ac3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:05.510631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1db0-a784-45f5-9009-e61f3e1ac3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:05.510904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1db0-a784-45f5-9009-e61f3e1ac3c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:05.511593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b1db0-a784-45f5-9009-e61f3e1ac3c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:05.513668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b1db0-a784-45f5-9009-e61f3e1ac3c1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:05.543819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1074/2121] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:05 2022] POST /identity/v3/users => generated 300 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:05.545731 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6042e-4dd5-4332-818a-93000df3b256 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:05.556584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6042e-4dd5-4332-818a-93000df3b256 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:05.561370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2579d4c-c40a-4c92-a51d-ead24a044305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:05.562116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2579d4c-c40a-4c92-a51d-ead24a044305 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:05.562521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2579d4c-c40a-4c92-a51d-ead24a044305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:05.562898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2579d4c-c40a-4c92-a51d-ead24a044305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:05.563634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2579d4c-c40a-4c92-a51d-ead24a044305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:05.565598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2579d4c-c40a-4c92-a51d-ead24a044305 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:05.576111 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:05.586009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1048/2122] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:05.590741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b1db0-a784-45f5-9009-e61f3e1ac3c1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:05.601778 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b1db0-a784-45f5-9009-e61f3e1ac3c1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:05.606839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7099f-e168-4038-b1ff-a7cc4586a1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:05.607545 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7099f-e168-4038-b1ff-a7cc4586a1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:05.607823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7099f-e168-4038-b1ff-a7cc4586a1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:05.608096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7099f-e168-4038-b1ff-a7cc4586a1c4 admin admin] PATH_INFO: `/v3/projects/10d24fe12eb74480b50bb72253b081e0/users/6cbc69c140b546a190220c748c614748/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:05.623841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7099f-e168-4038-b1ff-a7cc4586a1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d24fe12eb74480b50bb72253b081e0, user_id=6cbc69c140b546a190220c748c614748, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:05.626685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7099f-e168-4038-b1ff-a7cc4586a1c4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:05.643178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1075/2123] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:05 2022] PUT /identity/v3/projects/10d24fe12eb74480b50bb72253b081e0/users/6cbc69c140b546a190220c748c614748/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:05.647394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2579d4c-c40a-4c92-a51d-ead24a044305 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:05.658560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2579d4c-c40a-4c92-a51d-ead24a044305 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:05.723418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01d389-27e6-441a-9c77-1aeec5781708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:05.723903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d389-27e6-441a-9c77-1aeec5781708 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:05.724230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d389-27e6-441a-9c77-1aeec5781708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:05.724598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d389-27e6-441a-9c77-1aeec5781708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:05.725231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01d389-27e6-441a-9c77-1aeec5781708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:05.726843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01d389-27e6-441a-9c77-1aeec5781708 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:05.740423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1049/2124] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:11:05.741662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7099f-e168-4038-b1ff-a7cc4586a1c4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:05.753861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7099f-e168-4038-b1ff-a7cc4586a1c4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:05.760070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a799bb9-0e80-41c4-96d8-3c7012f34b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:05.760912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a799bb9-0e80-41c4-96d8-3c7012f34b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:05.761279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a799bb9-0e80-41c4-96d8-3c7012f34b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:05.761969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a799bb9-0e80-41c4-96d8-3c7012f34b03 admin admin] PATH_INFO: `/v3/projects/10d24fe12eb74480b50bb72253b081e0/users/6cbc69c140b546a190220c748c614748/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:05.764126 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a799bb9-0e80-41c4-96d8-3c7012f34b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d24fe12eb74480b50bb72253b081e0, user_id=6cbc69c140b546a190220c748c614748, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:05.767443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a799bb9-0e80-41c4-96d8-3c7012f34b03 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:05.778381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1076/2125] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:05 2022] PUT /identity/v3/projects/10d24fe12eb74480b50bb72253b081e0/users/6cbc69c140b546a190220c748c614748/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:05.789040 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce59157-1945-46fd-911d-011a3db8310b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:05.789545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce59157-1945-46fd-911d-011a3db8310b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:05.789654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce59157-1945-46fd-911d-011a3db8310b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:05.822937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1ce59157-1945-46fd-911d-011a3db8310b None None] MFA Rules not processed for user `6cbc69c140b546a190220c748c614748`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:05.825311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1ce59157-1945-46fd-911d-011a3db8310b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:05.911603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1050/2126] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:05.927445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a799bb9-0e80-41c4-96d8-3c7012f34b03 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:05.930115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6a799bb9-0e80-41c4-96d8-3c7012f34b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:05.991278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:06.038149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a799bb9-0e80-41c4-96d8-3c7012f34b03 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:06.043215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e56a7-5009-4f08-8340-9c0e3b47f0cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:06.052130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e56a7-5009-4f08-8340-9c0e3b47f0cc service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:06.053502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e56a7-5009-4f08-8340-9c0e3b47f0cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:06.053889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e56a7-5009-4f08-8340-9c0e3b47f0cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:06.068395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e56a7-5009-4f08-8340-9c0e3b47f0cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:06.070193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e56a7-5009-4f08-8340-9c0e3b47f0cc service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:06.082612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1077/2127] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:06.283538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce59157-1945-46fd-911d-011a3db8310b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:06.393123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e56a7-5009-4f08-8340-9c0e3b47f0cc service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:06.395108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-649e56a7-5009-4f08-8340-9c0e3b47f0cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:06.466070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce59157-1945-46fd-911d-011a3db8310b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:06.497374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:06.498313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:06.499195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:06.499519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] PATH_INFO: `/v3/users/fe6c2b9ae4a84e658e24eb22e764ebbb` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:06.502832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe6c2b9ae4a84e658e24eb22e764ebbb)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:06.504536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:06.536449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:06.566906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e56a7-5009-4f08-8340-9c0e3b47f0cc service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:06.588522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:06.590055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:06.590339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:06.590608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] PATH_INFO: `/v3/users/b4dfa908b0da4c96b5ff4ce428363544` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:06.596159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4dfa908b0da4c96b5ff4ce428363544)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:06.600117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:06.612048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe6c2b9ae4a84e658e24eb22e764ebbb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:06.627401 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe6c2b9ae4a84e658e24eb22e764ebbb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:06.629128 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe6c2b9ae4a84e658e24eb22e764ebbb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:06.648663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe6c2b9ae4a84e658e24eb22e764ebbb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:06.649565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-df6c2d33-3470-4201-a063-45eb2b3ade9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe6c2b9ae4a84e658e24eb22e764ebbb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:06.686325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1051/2128] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:06 2022] DELETE /identity/v3/users/fe6c2b9ae4a84e658e24eb22e764ebbb => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:06.702729 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f950e6-47ce-474a-9a54-f91d9861857a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:06.704405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f950e6-47ce-474a-9a54-f91d9861857a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:06.706053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f950e6-47ce-474a-9a54-f91d9861857a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:06.722013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4dfa908b0da4c96b5ff4ce428363544'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:06.725773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4dfa908b0da4c96b5ff4ce428363544'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:06.758727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-57f950e6-47ce-474a-9a54-f91d9861857a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:06.760250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-57f950e6-47ce-474a-9a54-f91d9861857a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:06.760970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4dfa908b0da4c96b5ff4ce428363544'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:06.776656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4dfa908b0da4c96b5ff4ce428363544'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:06.777712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59923e28-bd54-4b5c-a97d-1a03d4c7a07c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4dfa908b0da4c96b5ff4ce428363544'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:06.812562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1078/2129] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:06 2022] DELETE /identity/v3/users/b4dfa908b0da4c96b5ff4ce428363544 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:06.819014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b21533-80f7-4630-b816-30b4cf90b611 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:06.819950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b21533-80f7-4630-b816-30b4cf90b611 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:06.821461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b21533-80f7-4630-b816-30b4cf90b611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:06.887300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e9b21533-80f7-4630-b816-30b4cf90b611 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:06.893095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1052/2130] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:06.895054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e9b21533-80f7-4630-b816-30b4cf90b611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:06.905628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f950e6-47ce-474a-9a54-f91d9861857a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:06.909315 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-57f950e6-47ce-474a-9a54-f91d9861857a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:06.991128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:07.053246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1079/2131] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:11:07.091518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b21533-80f7-4630-b816-30b4cf90b611 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:07.106794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f950e6-47ce-474a-9a54-f91d9861857a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:07.302499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65825-7904-4aa4-93b5-eccc512e9317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:07.303139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65825-7904-4aa4-93b5-eccc512e9317 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:07.303419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65825-7904-4aa4-93b5-eccc512e9317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:07.303691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee65825-7904-4aa4-93b5-eccc512e9317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:07.315138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee65825-7904-4aa4-93b5-eccc512e9317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:07.320536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee65825-7904-4aa4-93b5-eccc512e9317 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:07.322793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b21533-80f7-4630-b816-30b4cf90b611 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:07.327297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597a433-accc-4bec-a15d-d50da1e78d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:07.328725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a433-accc-4bec-a15d-d50da1e78d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:07.328834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a433-accc-4bec-a15d-d50da1e78d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:07.329106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597a433-accc-4bec-a15d-d50da1e78d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:07.329229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:07.354641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1053/2132] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:11:07.375184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597a433-accc-4bec-a15d-d50da1e78d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:07.377107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597a433-accc-4bec-a15d-d50da1e78d79 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:07.397629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1080/2133] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:07.549183 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65825-7904-4aa4-93b5-eccc512e9317 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:07.551645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fee65825-7904-4aa4-93b5-eccc512e9317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:07.565672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee65825-7904-4aa4-93b5-eccc512e9317 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:07.570911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:07.571604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:07.571887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:07.572163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] PATH_INFO: `/v3/users/041507d810424dd7b34bff2e347bd52a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:07.573565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041507d810424dd7b34bff2e347bd52a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:07.575591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:07.631764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041507d810424dd7b34bff2e347bd52a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:07.640278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041507d810424dd7b34bff2e347bd52a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:07.641262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041507d810424dd7b34bff2e347bd52a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:07.658449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041507d810424dd7b34bff2e347bd52a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:07.659254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041507d810424dd7b34bff2e347bd52a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:07.695070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1054/2134] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:07 2022] DELETE /identity/v3/users/041507d810424dd7b34bff2e347bd52a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:07.843431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597a433-accc-4bec-a15d-d50da1e78d79 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:07.845351 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c597a433-accc-4bec-a15d-d50da1e78d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:07.860093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597a433-accc-4bec-a15d-d50da1e78d79 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:07.928724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:07.929428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:07.929711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:07.930015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] PATH_INFO: `/v3/projects/0acbff4bb83e4e60a20e53792c7abf7e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:07.931159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acbff4bb83e4e60a20e53792c7abf7e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:07.933117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:07.971704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:07.976643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:07.990658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf409-ccef-43c8-aa46-c581be71faf6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:08.030477 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acbff4bb83e4e60a20e53792c7abf7e', 'request_id': 'req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.037363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acbff4bb83e4e60a20e53792c7abf7e', 'request_id': 'req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.047650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acbff4bb83e4e60a20e53792c7abf7e', 'request_id': 'req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.062487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] The token cache is being invalidate because project 0acbff4bb83e4e60a20e53792c7abf7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:08.062862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.063457 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fc0d31b4-2c82-4c37-9b5e-96f991c9bb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.065072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1081/2135] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:07 2022] DELETE /identity/v3/projects/0acbff4bb83e4e60a20e53792c7abf7e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:08.070045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd53155-2d19-4ef3-a678-145d798dac74 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.070512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd53155-2d19-4ef3-a678-145d798dac74 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.070917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd53155-2d19-4ef3-a678-145d798dac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.074658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:08.075263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.075539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.075810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] PATH_INFO: `/v3/projects/6327080a250048f8a386d21288d735bc` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.076986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6327080a250048f8a386d21288d735bc)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:08.078922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:08.096155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ffd53155-2d19-4ef3-a678-145d798dac74 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:08.097663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ffd53155-2d19-4ef3-a678-145d798dac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:08.109202 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1082/2136] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:11:08.117432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebd09e-0cc9-457c-b9b0-bbb3577cada9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.118008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebd09e-0cc9-457c-b9b0-bbb3577cada9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.118661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebd09e-0cc9-457c-b9b0-bbb3577cada9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.136150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6327080a250048f8a386d21288d735bc', 'request_id': 'req-b401d764-c1c9-4a28-b4ab-35c802780350'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.142934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6327080a250048f8a386d21288d735bc', 'request_id': 'req-b401d764-c1c9-4a28-b4ab-35c802780350'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.146268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-13ebd09e-0cc9-457c-b9b0-bbb3577cada9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:08.148144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-13ebd09e-0cc9-457c-b9b0-bbb3577cada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:08.156001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:08.160014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6327080a250048f8a386d21288d735bc', 'request_id': 'req-b401d764-c1c9-4a28-b4ab-35c802780350'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.196528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] The token cache is being invalidate because project 6327080a250048f8a386d21288d735bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:08.197280 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.198141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.203864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1055/2137] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:07 2022] DELETE /identity/v3/projects/6327080a250048f8a386d21288d735bc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:08.205404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:08.207272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:08.227690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:08.266956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1083/2138] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:08.267910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebd09e-0cc9-457c-b9b0-bbb3577cada9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:08.269567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-13ebd09e-0cc9-457c-b9b0-bbb3577cada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:08.302530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebd09e-0cc9-457c-b9b0-bbb3577cada9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:08.309678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:08.310892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.311182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.311679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] PATH_INFO: `/v3/users/6cbc69c140b546a190220c748c614748` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.313064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbc69c140b546a190220c748c614748)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:08.315219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:08.334263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401d764-c1c9-4a28-b4ab-35c802780350 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:08.347735 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:08.348402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.348680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.348955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] PATH_INFO: `/v3/projects/8fa3b89a2f0a4d359ecef6b6e558f40e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.351362 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa3b89a2f0a4d359ecef6b6e558f40e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:08.353361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:08.409594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbc69c140b546a190220c748c614748'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.414505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbc69c140b546a190220c748c614748'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.427120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa3b89a2f0a4d359ecef6b6e558f40e', 'request_id': 'req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.434615 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbc69c140b546a190220c748c614748'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.435557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa3b89a2f0a4d359ecef6b6e558f40e', 'request_id': 'req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.448056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa3b89a2f0a4d359ecef6b6e558f40e', 'request_id': 'req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.469748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbc69c140b546a190220c748c614748'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.470415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf8fc6bf-cef8-4561-aa66-c05055e733c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbc69c140b546a190220c748c614748'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.488076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] The token cache is being invalidate because project 8fa3b89a2f0a4d359ecef6b6e558f40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:08.488376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.491357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:08.497609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1056/2139] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:08 2022] DELETE /identity/v3/projects/8fa3b89a2f0a4d359ecef6b6e558f40e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:08.497876 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:08.499864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:08.527255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1084/2140] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:08 2022] DELETE /identity/v3/users/6cbc69c140b546a190220c748c614748 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:08.529082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962679c6-8751-48fc-b266-e94ac53a4eb2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.533695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962679c6-8751-48fc-b266-e94ac53a4eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.534296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962679c6-8751-48fc-b266-e94ac53a4eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.586419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-962679c6-8751-48fc-b266-e94ac53a4eb2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:08.589912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-962679c6-8751-48fc-b266-e94ac53a4eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:08.654047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759cebf-b8c6-4eff-8bd7-30abcfa84cbd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:08.687703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1085/2141] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:08.695907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647848-19a9-4546-a46e-0fd08e53f95c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.696661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647848-19a9-4546-a46e-0fd08e53f95c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.697227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85647848-19a9-4546-a46e-0fd08e53f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.732701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-85647848-19a9-4546-a46e-0fd08e53f95c None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:08.735696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-85647848-19a9-4546-a46e-0fd08e53f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:08.750823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1086/2142] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:08.756289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85647848-19a9-4546-a46e-0fd08e53f95c None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:08.760011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:08.767851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85647848-19a9-4546-a46e-0fd08e53f95c None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:08.773650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758dcc6-d685-4bee-a104-5480693ad182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:08.774282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758dcc6-d685-4bee-a104-5480693ad182 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.774565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758dcc6-d685-4bee-a104-5480693ad182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.774844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758dcc6-d685-4bee-a104-5480693ad182 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.775635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758dcc6-d685-4bee-a104-5480693ad182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:08.776118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758dcc6-d685-4bee-a104-5480693ad182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:08.777829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758dcc6-d685-4bee-a104-5480693ad182 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:08.793067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1087/2143] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:11:08.797180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758dcc6-d685-4bee-a104-5480693ad182 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:08.805781 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:08.810398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dbaa0-607b-4c53-9b87-3ec738f41381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:08.811367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dbaa0-607b-4c53-9b87-3ec738f41381 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.811659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dbaa0-607b-4c53-9b87-3ec738f41381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.811943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dbaa0-607b-4c53-9b87-3ec738f41381 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.815989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758dcc6-d685-4bee-a104-5480693ad182 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:08.816770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dbaa0-607b-4c53-9b87-3ec738f41381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:08.817644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dbaa0-607b-4c53-9b87-3ec738f41381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:08.820760 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dbaa0-607b-4c53-9b87-3ec738f41381 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:08.828038 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a873f6-c32a-4c6b-bba6-86b6b3850eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:08.829298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a873f6-c32a-4c6b-bba6-86b6b3850eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.829790 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a873f6-c32a-4c6b-bba6-86b6b3850eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.830711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a873f6-c32a-4c6b-bba6-86b6b3850eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.832099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a873f6-c32a-4c6b-bba6-86b6b3850eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:08.839243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1057/2144] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:11:08.839432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a873f6-c32a-4c6b-bba6-86b6b3850eb4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:08.840669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dbaa0-607b-4c53-9b87-3ec738f41381 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:08.852918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dbaa0-607b-4c53-9b87-3ec738f41381 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:08.872662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31850fd-ba12-4361-b7bf-cfa01a1f3bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:08.873157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31850fd-ba12-4361-b7bf-cfa01a1f3bce admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:08.873658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31850fd-ba12-4361-b7bf-cfa01a1f3bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:08.874575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31850fd-ba12-4361-b7bf-cfa01a1f3bce admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:08.875680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31850fd-ba12-4361-b7bf-cfa01a1f3bce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:08.878980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31850fd-ba12-4361-b7bf-cfa01a1f3bce admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:08.886064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1088/2145] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:08 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:08.890488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a873f6-c32a-4c6b-bba6-86b6b3850eb4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:08.946733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1058/2146] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:08 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:08.951022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31850fd-ba12-4361-b7bf-cfa01a1f3bce admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:08.987446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a873f6-c32a-4c6b-bba6-86b6b3850eb4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.041693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31850fd-ba12-4361-b7bf-cfa01a1f3bce admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.046925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71d8df-e234-4e35-8be7-c3b24e630489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.047553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d8df-e234-4e35-8be7-c3b24e630489 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.047817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d8df-e234-4e35-8be7-c3b24e630489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.048103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71d8df-e234-4e35-8be7-c3b24e630489 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.048784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71d8df-e234-4e35-8be7-c3b24e630489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.051019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71d8df-e234-4e35-8be7-c3b24e630489 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.063521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41bb8f-1e9a-42fa-9259-8c7bc577d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.064155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41bb8f-1e9a-42fa-9259-8c7bc577d2de admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.064556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41bb8f-1e9a-42fa-9259-8c7bc577d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.064872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41bb8f-1e9a-42fa-9259-8c7bc577d2de admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.065743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41bb8f-1e9a-42fa-9259-8c7bc577d2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.068009 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41bb8f-1e9a-42fa-9259-8c7bc577d2de admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.074896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1059/2147] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:08 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:11:09.075915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71d8df-e234-4e35-8be7-c3b24e630489 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.077882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5b71d8df-e234-4e35-8be7-c3b24e630489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:09.092712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71d8df-e234-4e35-8be7-c3b24e630489 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.093514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1089/2148] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:08 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:09.094330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41bb8f-1e9a-42fa-9259-8c7bc577d2de admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.101901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.102800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.103063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.103340 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] PATH_INFO: `/v3/projects/10d24fe12eb74480b50bb72253b081e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.103917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41bb8f-1e9a-42fa-9259-8c7bc577d2de admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.104466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d24fe12eb74480b50bb72253b081e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.106473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.110337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d340f-fc21-49b9-9430-a708f38d3c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.111044 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d340f-fc21-49b9-9430-a708f38d3c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.111480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d340f-fc21-49b9-9430-a708f38d3c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.111983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d340f-fc21-49b9-9430-a708f38d3c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.112647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d340f-fc21-49b9-9430-a708f38d3c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.114592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d340f-fc21-49b9-9430-a708f38d3c88 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.125144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1090/2149] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:09.126039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d340f-fc21-49b9-9430-a708f38d3c88 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.136366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d340f-fc21-49b9-9430-a708f38d3c88 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.141769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2962e-eab1-4cda-a173-921c707a183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.142416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2962e-eab1-4cda-a173-921c707a183f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.143298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2962e-eab1-4cda-a173-921c707a183f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.143298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2962e-eab1-4cda-a173-921c707a183f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.143714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2962e-eab1-4cda-a173-921c707a183f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.145642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2962e-eab1-4cda-a173-921c707a183f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.158463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1091/2150] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:09.159341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2962e-eab1-4cda-a173-921c707a183f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.169866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2962e-eab1-4cda-a173-921c707a183f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.170610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d24fe12eb74480b50bb72253b081e0', 'request_id': 'req-8d6bfe42-bebc-4326-b157-dcb83931ce4f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:09.176779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d24fe12eb74480b50bb72253b081e0', 'request_id': 'req-8d6bfe42-bebc-4326-b157-dcb83931ce4f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:09.184222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d24fe12eb74480b50bb72253b081e0', 'request_id': 'req-8d6bfe42-bebc-4326-b157-dcb83931ce4f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:09.196422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] The token cache is being invalidate because project 10d24fe12eb74480b50bb72253b081e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:09.196788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:09.197484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:09.199045 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1060/2151] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:09 2022] DELETE /identity/v3/projects/10d24fe12eb74480b50bb72253b081e0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:09.199800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.201517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:09.223487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:09.229801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:09.230840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9702aa0-3bea-4c99-a22a-01973b8dd739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.232064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9702aa0-3bea-4c99-a22a-01973b8dd739 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.232690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9702aa0-3bea-4c99-a22a-01973b8dd739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.233293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9702aa0-3bea-4c99-a22a-01973b8dd739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.233945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9702aa0-3bea-4c99-a22a-01973b8dd739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.235925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9702aa0-3bea-4c99-a22a-01973b8dd739 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.251422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1092/2152] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:09.252793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0323c-4a21-4893-ba4b-7c8d4fdaebf4 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.253189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0323c-4a21-4893-ba4b-7c8d4fdaebf4 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.253667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0323c-4a21-4893-ba4b-7c8d4fdaebf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.277160 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-60a0323c-4a21-4893-ba4b-7c8d4fdaebf4 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:09.278677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-60a0323c-4a21-4893-ba4b-7c8d4fdaebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:09.278858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bfe42-bebc-4326-b157-dcb83931ce4f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.291422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869896a-62bd-4d0b-a554-86c5558b09a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.292071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869896a-62bd-4d0b-a554-86c5558b09a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.292351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869896a-62bd-4d0b-a554-86c5558b09a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.292627 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869896a-62bd-4d0b-a554-86c5558b09a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.293102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1093/2153] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:09.293317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869896a-62bd-4d0b-a554-86c5558b09a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.293899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0323c-4a21-4893-ba4b-7c8d4fdaebf4 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.295161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869896a-62bd-4d0b-a554-86c5558b09a6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.295287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-60a0323c-4a21-4893-ba4b-7c8d4fdaebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:09.309809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1061/2154] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:09.309809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ba0c2-0444-4781-a39d-53bfebdf4434 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.310087 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0323c-4a21-4893-ba4b-7c8d4fdaebf4 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.310199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ba0c2-0444-4781-a39d-53bfebdf4434 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.310293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ba0c2-0444-4781-a39d-53bfebdf4434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.314818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19711c85-18f6-47f5-910c-9005dacc1788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.315490 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19711c85-18f6-47f5-910c-9005dacc1788 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.315774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19711c85-18f6-47f5-910c-9005dacc1788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.316116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19711c85-18f6-47f5-910c-9005dacc1788 admin admin] PATH_INFO: `/v3/projects/7630d747ab304dce915e6cdec0720d41/users/80e6034ebd0b465c9abd3fb0bcfe04e3/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.330987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-172ba0c2-0444-4781-a39d-53bfebdf4434 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:09.331152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19711c85-18f6-47f5-910c-9005dacc1788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7630d747ab304dce915e6cdec0720d41, user_id=80e6034ebd0b465c9abd3fb0bcfe04e3, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.332227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-172ba0c2-0444-4781-a39d-53bfebdf4434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:09.333898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19711c85-18f6-47f5-910c-9005dacc1788 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.340723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1062/2155] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:09.341561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ba0c2-0444-4781-a39d-53bfebdf4434 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.353139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1094/2156] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:09 2022] PUT /identity/v3/projects/7630d747ab304dce915e6cdec0720d41/users/80e6034ebd0b465c9abd3fb0bcfe04e3/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:09.354090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19711c85-18f6-47f5-910c-9005dacc1788 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.358011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ba0c2-0444-4781-a39d-53bfebdf4434 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.420671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19711c85-18f6-47f5-910c-9005dacc1788 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.425320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522a07f-622a-4437-90a0-41716e97a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.425696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deaf0e-6700-4c88-b4f4-916e003335c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.425984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a07f-622a-4437-90a0-41716e97a030 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.426271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a07f-622a-4437-90a0-41716e97a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.426387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deaf0e-6700-4c88-b4f4-916e003335c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.426559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a07f-622a-4437-90a0-41716e97a030 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.426654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deaf0e-6700-4c88-b4f4-916e003335c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.426877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deaf0e-6700-4c88-b4f4-916e003335c2 admin admin] PATH_INFO: `/v3/projects/a07a664acf7a40cab34f30ee9ab43c61/users/ca12607363574ef0a0a721533e676824/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.427210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522a07f-622a-4437-90a0-41716e97a030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:09.427519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522a07f-622a-4437-90a0-41716e97a030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.429157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522a07f-622a-4437-90a0-41716e97a030 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.440839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1095/2157] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:11:09.441307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deaf0e-6700-4c88-b4f4-916e003335c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07a664acf7a40cab34f30ee9ab43c61, user_id=ca12607363574ef0a0a721533e676824, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.443970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deaf0e-6700-4c88-b4f4-916e003335c2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.445927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061bc0-dbdb-4133-869a-96205f33ccce None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.446234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061bc0-dbdb-4133-869a-96205f33ccce None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.446496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061bc0-dbdb-4133-869a-96205f33ccce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.459051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1063/2158] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:09 2022] PUT /identity/v3/projects/a07a664acf7a40cab34f30ee9ab43c61/users/ca12607363574ef0a0a721533e676824/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:09.460455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deaf0e-6700-4c88-b4f4-916e003335c2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.478436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c9061bc0-dbdb-4133-869a-96205f33ccce None None] MFA Rules not processed for user `80e6034ebd0b465c9abd3fb0bcfe04e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:09.479739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c9061bc0-dbdb-4133-869a-96205f33ccce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:09.529352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deaf0e-6700-4c88-b4f4-916e003335c2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.533944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9fa4b-036a-4396-88c0-203faf2e1a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.534551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9fa4b-036a-4396-88c0-203faf2e1a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.534955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9fa4b-036a-4396-88c0-203faf2e1a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.535175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9fa4b-036a-4396-88c0-203faf2e1a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.535838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9fa4b-036a-4396-88c0-203faf2e1a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.537804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9fa4b-036a-4396-88c0-203faf2e1a08 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.544263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1096/2159] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:09.545543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee688352-20f0-4c32-81ff-3c599e02198e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.545828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee688352-20f0-4c32-81ff-3c599e02198e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.546099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee688352-20f0-4c32-81ff-3c599e02198e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.566201 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ee688352-20f0-4c32-81ff-3c599e02198e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:09.566817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1064/2160] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:09 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:09.567562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ee688352-20f0-4c32-81ff-3c599e02198e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:09.568618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9fa4b-036a-4396-88c0-203faf2e1a08 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.596274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:09.617800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:09.646572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9fa4b-036a-4396-88c0-203faf2e1a08 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.649112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1097/2161] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:09.650663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee688352-20f0-4c32-81ff-3c599e02198e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.656925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe56e2b-5116-43b8-9c89-d1e85a7fbc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.657849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe56e2b-5116-43b8-9c89-d1e85a7fbc74 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.658194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe56e2b-5116-43b8-9c89-d1e85a7fbc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.658591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe56e2b-5116-43b8-9c89-d1e85a7fbc74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.659403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe56e2b-5116-43b8-9c89-d1e85a7fbc74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.661862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe56e2b-5116-43b8-9c89-d1e85a7fbc74 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.670655 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee688352-20f0-4c32-81ff-3c599e02198e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.679774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43adf51-b91f-4b42-8c58-d727ed7e9359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.680863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43adf51-b91f-4b42-8c58-d727ed7e9359 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.681425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43adf51-b91f-4b42-8c58-d727ed7e9359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.681914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43adf51-b91f-4b42-8c58-d727ed7e9359 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.683160 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43adf51-b91f-4b42-8c58-d727ed7e9359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.687530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43adf51-b91f-4b42-8c58-d727ed7e9359 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.700146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1065/2162] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:09 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:09.701306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe56e2b-5116-43b8-9c89-d1e85a7fbc74 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.703023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-abe56e2b-5116-43b8-9c89-d1e85a7fbc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:09.722156 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1098/2163] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:09 2022] POST /identity/v3/users => generated 297 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:09.723930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43adf51-b91f-4b42-8c58-d727ed7e9359 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.737200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43adf51-b91f-4b42-8c58-d727ed7e9359 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.767553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe56e2b-5116-43b8-9c89-d1e85a7fbc74 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.777154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686e7c-126b-4aca-b670-9b529d1f7884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.777961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686e7c-126b-4aca-b670-9b529d1f7884 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.778399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686e7c-126b-4aca-b670-9b529d1f7884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.778676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc686e7c-126b-4aca-b670-9b529d1f7884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.805216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c63e48-99e9-483f-a316-2e65624823f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.806149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c63e48-99e9-483f-a316-2e65624823f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.806149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c63e48-99e9-483f-a316-2e65624823f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.806830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c63e48-99e9-483f-a316-2e65624823f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.807488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c63e48-99e9-483f-a316-2e65624823f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.810500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c63e48-99e9-483f-a316-2e65624823f4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.835625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1099/2164] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:09 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:09.836727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c63e48-99e9-483f-a316-2e65624823f4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.846882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c63e48-99e9-483f-a316-2e65624823f4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.851625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb424d9-4310-41ef-9781-309f98818725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.852216 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb424d9-4310-41ef-9781-309f98818725 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.852495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb424d9-4310-41ef-9781-309f98818725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.852766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb424d9-4310-41ef-9781-309f98818725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.853440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb424d9-4310-41ef-9781-309f98818725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.855036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb424d9-4310-41ef-9781-309f98818725 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.858117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc686e7c-126b-4aca-b670-9b529d1f7884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.859699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc686e7c-126b-4aca-b670-9b529d1f7884 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.865618 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1100/2165] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:09.866406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb424d9-4310-41ef-9781-309f98818725 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.872042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1066/2166] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:09.872857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686e7c-126b-4aca-b670-9b529d1f7884 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.877070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb424d9-4310-41ef-9781-309f98818725 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.882680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc686e7c-126b-4aca-b670-9b529d1f7884 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.883109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3512f-bb83-446c-8dce-aa2aa7e9d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.883726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3512f-bb83-446c-8dce-aa2aa7e9d446 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.884031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3512f-bb83-446c-8dce-aa2aa7e9d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.884275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3512f-bb83-446c-8dce-aa2aa7e9d446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.884920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3512f-bb83-446c-8dce-aa2aa7e9d446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.886546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3512f-bb83-446c-8dce-aa2aa7e9d446 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.888252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa1612-9f26-452a-a5b8-546f1c72901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.888943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa1612-9f26-452a-a5b8-546f1c72901c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.889275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa1612-9f26-452a-a5b8-546f1c72901c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.889607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa1612-9f26-452a-a5b8-546f1c72901c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.890256 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa1612-9f26-452a-a5b8-546f1c72901c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.891836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa1612-9f26-452a-a5b8-546f1c72901c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.897489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1101/2167] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:09.901793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3512f-bb83-446c-8dce-aa2aa7e9d446 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.904176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1067/2168] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:09.908528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa1612-9f26-452a-a5b8-546f1c72901c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.913776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3512f-bb83-446c-8dce-aa2aa7e9d446 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.918900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7264e51-465a-4951-b620-2bf2faa121dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.919463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa1612-9f26-452a-a5b8-546f1c72901c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.919841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264e51-465a-4951-b620-2bf2faa121dc admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.920222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264e51-465a-4951-b620-2bf2faa121dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.920468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264e51-465a-4951-b620-2bf2faa121dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.922535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7264e51-465a-4951-b620-2bf2faa121dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.923025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7264e51-465a-4951-b620-2bf2faa121dc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.927648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258bb7d-a2eb-40ad-a71b-f015af1deb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.928526 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258bb7d-a2eb-40ad-a71b-f015af1deb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.929010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258bb7d-a2eb-40ad-a71b-f015af1deb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.929449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258bb7d-a2eb-40ad-a71b-f015af1deb7a admin admin] PATH_INFO: `/v3/projects/74ff6257287b4f108e2a54c24efafe2c/users/7d3000179082472db7c8bd33c0279aa9/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.937086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1102/2169] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:11:09.942154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7264e51-465a-4951-b620-2bf2faa121dc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:09.956678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258bb7d-a2eb-40ad-a71b-f015af1deb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ff6257287b4f108e2a54c24efafe2c, user_id=7d3000179082472db7c8bd33c0279aa9, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:09.958295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7264e51-465a-4951-b620-2bf2faa121dc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:09.959766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258bb7d-a2eb-40ad-a71b-f015af1deb7a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:09.964505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55781c7-0240-4cae-8928-2772c10f9361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:09.965537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55781c7-0240-4cae-8928-2772c10f9361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:09.965740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55781c7-0240-4cae-8928-2772c10f9361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:09.966012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55781c7-0240-4cae-8928-2772c10f9361 admin admin] PATH_INFO: `/v3/projects/7095524e7228441f99b920652308ca90/users/7695aba975eb490692d7394748b56668/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:09.994100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1068/2170] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:09 2022] PUT /identity/v3/projects/74ff6257287b4f108e2a54c24efafe2c/users/7d3000179082472db7c8bd33c0279aa9/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:10.006422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55781c7-0240-4cae-8928-2772c10f9361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7095524e7228441f99b920652308ca90, user_id=7695aba975eb490692d7394748b56668, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:10.009157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55781c7-0240-4cae-8928-2772c10f9361 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:10.011863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c8e60-942b-4307-9708-2524453d0d22 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.012114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c8e60-942b-4307-9708-2524453d0d22 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.012669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c8e60-942b-4307-9708-2524453d0d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.036083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1103/2171] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:09 2022] PUT /identity/v3/projects/7095524e7228441f99b920652308ca90/users/7695aba975eb490692d7394748b56668/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:10.047730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0cfb9-d476-42f0-b75d-a63a80cd6293 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.048067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0cfb9-d476-42f0-b75d-a63a80cd6293 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.048505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0cfb9-d476-42f0-b75d-a63a80cd6293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.066663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-092c8e60-942b-4307-9708-2524453d0d22 None None] MFA Rules not processed for user `7d3000179082472db7c8bd33c0279aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:10.069068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-092c8e60-942b-4307-9708-2524453d0d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:10.095447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:10.096092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5bf0cfb9-d476-42f0-b75d-a63a80cd6293 None None] MFA Rules not processed for user `7695aba975eb490692d7394748b56668`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:10.097905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5bf0cfb9-d476-42f0-b75d-a63a80cd6293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:10.161679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:10.185497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1104/2172] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:10.185902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0cfb9-d476-42f0-b75d-a63a80cd6293 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:10.188056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5bf0cfb9-d476-42f0-b75d-a63a80cd6293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:10.223642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1069/2173] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:10.223642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c8e60-942b-4307-9708-2524453d0d22 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:10.292833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0cfb9-d476-42f0-b75d-a63a80cd6293 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:10.302096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:10.302807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.303085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.303357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] PATH_INFO: `/v3/users/ddd5a590ffba43d9bd5455f4a092c9ea` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.304699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd5a590ffba43d9bd5455f4a092c9ea)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:10.306852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:10.324264 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c8e60-942b-4307-9708-2524453d0d22 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:10.334352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8b2ac-45b2-48c0-a6a2-5d3bb29e392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:10.335460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b2ac-45b2-48c0-a6a2-5d3bb29e392e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.335937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b2ac-45b2-48c0-a6a2-5d3bb29e392e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.336454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b2ac-45b2-48c0-a6a2-5d3bb29e392e admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.337327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8b2ac-45b2-48c0-a6a2-5d3bb29e392e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:10.345951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8b2ac-45b2-48c0-a6a2-5d3bb29e392e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:10.388904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd5a590ffba43d9bd5455f4a092c9ea'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:10.389911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd5a590ffba43d9bd5455f4a092c9ea'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:10.405834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd5a590ffba43d9bd5455f4a092c9ea'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:10.406766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1070/2174] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:10 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:10.407862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8b2ac-45b2-48c0-a6a2-5d3bb29e392e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:10.422282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd5a590ffba43d9bd5455f4a092c9ea'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:10.423970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd5a590ffba43d9bd5455f4a092c9ea'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:10.446247 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1105/2175] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:10 2022] DELETE /identity/v3/users/ddd5a590ffba43d9bd5455f4a092c9ea => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:10.450574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:10.452254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:10.511697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8b2ac-45b2-48c0-a6a2-5d3bb29e392e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:10.559987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9adae7-24d3-4fcc-996a-cb2a768d615a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:10.571716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b627f4-b8ae-4e97-8485-df8591e3ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:10.572873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b627f4-b8ae-4e97-8485-df8591e3ba81 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.573202 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b627f4-b8ae-4e97-8485-df8591e3ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.574486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b627f4-b8ae-4e97-8485-df8591e3ba81 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.576896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b627f4-b8ae-4e97-8485-df8591e3ba81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:10.579136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b627f4-b8ae-4e97-8485-df8591e3ba81 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:10.587383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:10.612486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:10.620916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1106/2176] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:10 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:10.624283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59ca9d-1946-4ab2-9e18-9682c2d08de9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.626349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd499f-9c71-4a25-949f-07bc8e9755f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:10.626992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd499f-9c71-4a25-949f-07bc8e9755f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.627525 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59ca9d-1946-4ab2-9e18-9682c2d08de9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.627929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59ca9d-1946-4ab2-9e18-9682c2d08de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.628374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd499f-9c71-4a25-949f-07bc8e9755f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.628748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd499f-9c71-4a25-949f-07bc8e9755f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.632712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd499f-9c71-4a25-949f-07bc8e9755f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:10.635329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd499f-9c71-4a25-949f-07bc8e9755f0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:10.660178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-be59ca9d-1946-4ab2-9e18-9682c2d08de9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:10.662817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-be59ca9d-1946-4ab2-9e18-9682c2d08de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:10.673123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1107/2177] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:10.674401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59ca9d-1946-4ab2-9e18-9682c2d08de9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:10.683451 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1071/2178] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:10 2022] POST /identity/v3/projects => generated 393 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:10.688657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd499f-9c71-4a25-949f-07bc8e9755f0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:10.692179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c8bd499f-9c71-4a25-949f-07bc8e9755f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:10.698512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59ca9d-1946-4ab2-9e18-9682c2d08de9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:10.755397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd499f-9c71-4a25-949f-07bc8e9755f0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:10.759651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54c928-f196-42ba-ab81-f4fb0e555968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:10.760447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54c928-f196-42ba-ab81-f4fb0e555968 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.760791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54c928-f196-42ba-ab81-f4fb0e555968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.761171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54c928-f196-42ba-ab81-f4fb0e555968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.762362 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467bbeb-a45d-47b3-b72a-dc28bdcf968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:10.762981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467bbeb-a45d-47b3-b72a-dc28bdcf968a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.763299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467bbeb-a45d-47b3-b72a-dc28bdcf968a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.763526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467bbeb-a45d-47b3-b72a-dc28bdcf968a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.764811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467bbeb-a45d-47b3-b72a-dc28bdcf968a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:10.766464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467bbeb-a45d-47b3-b72a-dc28bdcf968a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:10.772999 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54c928-f196-42ba-ab81-f4fb0e555968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:10.774575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54c928-f196-42ba-ab81-f4fb0e555968 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:10.781571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1108/2179] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:10.782552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467bbeb-a45d-47b3-b72a-dc28bdcf968a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:10.785964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1072/2180] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:10.787421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d467bbeb-a45d-47b3-b72a-dc28bdcf968a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:10.790043 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54c928-f196-42ba-ab81-f4fb0e555968 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:10.804005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467bbeb-a45d-47b3-b72a-dc28bdcf968a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:10.804260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54c928-f196-42ba-ab81-f4fb0e555968 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:10.809922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad980e85-1681-44e5-b8e1-7e7de2eb4da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:10.810512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30640e5-c427-4773-8543-00819656de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:10.810650 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad980e85-1681-44e5-b8e1-7e7de2eb4da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.810936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad980e85-1681-44e5-b8e1-7e7de2eb4da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.811229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad980e85-1681-44e5-b8e1-7e7de2eb4da8 admin admin] PATH_INFO: `/v3/projects/20347154711c46ada1b4606dc38ec7ab/users/7535d461a8e44f4c839785386700e24e/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.811358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30640e5-c427-4773-8543-00819656de95 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:10.814058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30640e5-c427-4773-8543-00819656de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:10.814058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30640e5-c427-4773-8543-00819656de95 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:10.814058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30640e5-c427-4773-8543-00819656de95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:10.814943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30640e5-c427-4773-8543-00819656de95 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:10.831478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad980e85-1681-44e5-b8e1-7e7de2eb4da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20347154711c46ada1b4606dc38ec7ab, user_id=7535d461a8e44f4c839785386700e24e, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:10.848898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad980e85-1681-44e5-b8e1-7e7de2eb4da8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:10.854880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1109/2181] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:10 2022] POST /identity/v3/users => generated 303 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:10.859534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30640e5-c427-4773-8543-00819656de95 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:10.893116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30640e5-c427-4773-8543-00819656de95 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:10.913364 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1073/2182] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:10 2022] PUT /identity/v3/projects/20347154711c46ada1b4606dc38ec7ab/users/7535d461a8e44f4c839785386700e24e/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:10.915768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad980e85-1681-44e5-b8e1-7e7de2eb4da8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:11.024976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1f588-bd25-4680-8966-352142596729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:11.025644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1f588-bd25-4680-8966-352142596729 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.025928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1f588-bd25-4680-8966-352142596729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.026246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1f588-bd25-4680-8966-352142596729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.027524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1f588-bd25-4680-8966-352142596729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:11.029861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1f588-bd25-4680-8966-352142596729 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:11.052612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1110/2183] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:11.054546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad980e85-1681-44e5-b8e1-7e7de2eb4da8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:11.057435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1f588-bd25-4680-8966-352142596729 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:11.064495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112f0d5-6ff0-41f6-a4df-5ba1373f42d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:11.065166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112f0d5-6ff0-41f6-a4df-5ba1373f42d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.065504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112f0d5-6ff0-41f6-a4df-5ba1373f42d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.065780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112f0d5-6ff0-41f6-a4df-5ba1373f42d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.066642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112f0d5-6ff0-41f6-a4df-5ba1373f42d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:11.068496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112f0d5-6ff0-41f6-a4df-5ba1373f42d0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:11.084345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1074/2184] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:11.084547 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1f588-bd25-4680-8966-352142596729 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:11.085717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112f0d5-6ff0-41f6-a4df-5ba1373f42d0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:11.098445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f88b-a396-4a7b-b38c-8f2376ba8b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:11.104054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f88b-a396-4a7b-b38c-8f2376ba8b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.104409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f88b-a396-4a7b-b38c-8f2376ba8b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.104656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f88b-a396-4a7b-b38c-8f2376ba8b00 admin admin] PATH_INFO: `/v3/projects/25fbbc60b004421fb06db529377575f0/users/351013d1b3f241ec9d8c695a4beea66a/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.111266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112f0d5-6ff0-41f6-a4df-5ba1373f42d0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:11.120940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef49701-2a5d-4c96-b1bd-899d00bd3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:11.121914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef49701-2a5d-4c96-b1bd-899d00bd3d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.122263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef49701-2a5d-4c96-b1bd-899d00bd3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.122612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef49701-2a5d-4c96-b1bd-899d00bd3d03 admin admin] PATH_INFO: `/v3/projects/20347154711c46ada1b4606dc38ec7ab/users/7535d461a8e44f4c839785386700e24e/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.124689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef49701-2a5d-4c96-b1bd-899d00bd3d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20347154711c46ada1b4606dc38ec7ab, user_id=7535d461a8e44f4c839785386700e24e, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:11.127656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef49701-2a5d-4c96-b1bd-899d00bd3d03 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:11.131946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f88b-a396-4a7b-b38c-8f2376ba8b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fbbc60b004421fb06db529377575f0, user_id=351013d1b3f241ec9d8c695a4beea66a, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:11.135282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f88b-a396-4a7b-b38c-8f2376ba8b00 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:11.153513 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1075/2185] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:11 2022] PUT /identity/v3/projects/20347154711c46ada1b4606dc38ec7ab/users/7535d461a8e44f4c839785386700e24e/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:11.155149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fee8c8-d6df-4f17-b898-dd751df1be0d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.155507 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fee8c8-d6df-4f17-b898-dd751df1be0d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.155791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fee8c8-d6df-4f17-b898-dd751df1be0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.170254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1111/2186] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:11 2022] PUT /identity/v3/projects/25fbbc60b004421fb06db529377575f0/users/351013d1b3f241ec9d8c695a4beea66a/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:11.178258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f88b-a396-4a7b-b38c-8f2376ba8b00 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:11.199079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f2fee8c8-d6df-4f17-b898-dd751df1be0d None None] MFA Rules not processed for user `7535d461a8e44f4c839785386700e24e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:11.200275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f2fee8c8-d6df-4f17-b898-dd751df1be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:11.225756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:11.311660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:11.340502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1076/2187] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:11:11.343233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f88b-a396-4a7b-b38c-8f2376ba8b00 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:11.349586 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fee8c8-d6df-4f17-b898-dd751df1be0d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:11.351964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f2fee8c8-d6df-4f17-b898-dd751df1be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:11.377945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22560197-7a5e-4b49-8dac-37a9e027305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:11.379933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560197-7a5e-4b49-8dac-37a9e027305f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.381811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560197-7a5e-4b49-8dac-37a9e027305f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.382756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560197-7a5e-4b49-8dac-37a9e027305f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.384204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22560197-7a5e-4b49-8dac-37a9e027305f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:11.389064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22560197-7a5e-4b49-8dac-37a9e027305f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:11.425711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1112/2188] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:11.427103 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22560197-7a5e-4b49-8dac-37a9e027305f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:11.444313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22560197-7a5e-4b49-8dac-37a9e027305f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:11.465886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b43d3-fbed-46f8-abbb-9299fd34dda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:11.466587 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b43d3-fbed-46f8-abbb-9299fd34dda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.466866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b43d3-fbed-46f8-abbb-9299fd34dda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.467143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b43d3-fbed-46f8-abbb-9299fd34dda5 admin admin] PATH_INFO: `/v3/projects/25fbbc60b004421fb06db529377575f0/users/351013d1b3f241ec9d8c695a4beea66a/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.469462 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b43d3-fbed-46f8-abbb-9299fd34dda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25fbbc60b004421fb06db529377575f0, user_id=351013d1b3f241ec9d8c695a4beea66a, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:11.472371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b43d3-fbed-46f8-abbb-9299fd34dda5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:11.496651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1113/2189] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:11 2022] PUT /identity/v3/projects/25fbbc60b004421fb06db529377575f0/users/351013d1b3f241ec9d8c695a4beea66a/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:11.497400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b43d3-fbed-46f8-abbb-9299fd34dda5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:11.503040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f62b43d3-fbed-46f8-abbb-9299fd34dda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:11.515276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fee8c8-d6df-4f17-b898-dd751df1be0d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:11.660528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b43d3-fbed-46f8-abbb-9299fd34dda5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:11.666453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:11.667306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.667644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.667991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] PATH_INFO: `/v3/projects/0679969b94ee430ba80c1bccce4cb79e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.669242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0679969b94ee430ba80c1bccce4cb79e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:11.672203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:11.687698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df06d2-1a94-4b6a-be01-888e4ca3d97f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:11.690076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df06d2-1a94-4b6a-be01-888e4ca3d97f service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.690367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df06d2-1a94-4b6a-be01-888e4ca3d97f service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.690641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df06d2-1a94-4b6a-be01-888e4ca3d97f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.698063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-38df06d2-1a94-4b6a-be01-888e4ca3d97f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:11.773628 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0679969b94ee430ba80c1bccce4cb79e', 'request_id': 'req-3ca2179e-b257-4ba5-81b1-e31fda3107f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:11.780816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0679969b94ee430ba80c1bccce4cb79e', 'request_id': 'req-3ca2179e-b257-4ba5-81b1-e31fda3107f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:11.794336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0679969b94ee430ba80c1bccce4cb79e', 'request_id': 'req-3ca2179e-b257-4ba5-81b1-e31fda3107f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:11.811344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] The token cache is being invalidate because project 0679969b94ee430ba80c1bccce4cb79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:11.811499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:11.812425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3ca2179e-b257-4ba5-81b1-e31fda3107f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:11.814714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1114/2190] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:11 2022] DELETE /identity/v3/projects/0679969b94ee430ba80c1bccce4cb79e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:11.816065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48b05-fe9e-46ad-842d-ea5e882ce211 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.816361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48b05-fe9e-46ad-842d-ea5e882ce211 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.816634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e48b05-fe9e-46ad-842d-ea5e882ce211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.854084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df06d2-1a94-4b6a-be01-888e4ca3d97f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:11.856053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df06d2-1a94-4b6a-be01-888e4ca3d97f service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:11.867910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1077/2191] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:11.868777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df06d2-1a94-4b6a-be01-888e4ca3d97f service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:11.868912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e0e48b05-fe9e-46ad-842d-ea5e882ce211 None None] MFA Rules not processed for user `351013d1b3f241ec9d8c695a4beea66a`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:11.870895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e0e48b05-fe9e-46ad-842d-ea5e882ce211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:11.883103 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df06d2-1a94-4b6a-be01-888e4ca3d97f service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:11.915478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:11.962118 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:11.963483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:11.964336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:11.964467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] PATH_INFO: `/v3/users/d4cbd1a588b4474ea62ea069238915af` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:11.965790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4cbd1a588b4474ea62ea069238915af)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:11.968207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:11.983043 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:12.048530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1115/2192] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:12.064236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e48b05-fe9e-46ad-842d-ea5e882ce211 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:12.065383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4cbd1a588b4474ea62ea069238915af'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:12.065848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e0e48b05-fe9e-46ad-842d-ea5e882ce211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:12.080791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4cbd1a588b4474ea62ea069238915af'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:12.083996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4cbd1a588b4474ea62ea069238915af'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:12.107550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4cbd1a588b4474ea62ea069238915af'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:12.109230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4cbd1a588b4474ea62ea069238915af'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:12.148651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1078/2193] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:11 2022] DELETE /identity/v3/users/d4cbd1a588b4474ea62ea069238915af => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:12.180338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e48b05-fe9e-46ad-842d-ea5e882ce211 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:12.301324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8daa-9d93-4932-9e0a-f87a154d6fb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:12.302117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8daa-9d93-4932-9e0a-f87a154d6fb6 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:12.307472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8daa-9d93-4932-9e0a-f87a154d6fb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:12.307801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c8daa-9d93-4932-9e0a-f87a154d6fb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:12.328672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-071c8daa-9d93-4932-9e0a-f87a154d6fb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:12.538825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c8daa-9d93-4932-9e0a-f87a154d6fb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:12.542673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c8daa-9d93-4932-9e0a-f87a154d6fb6 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:12.562308 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1116/2194] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:11:12.623689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:12.626154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:12.641001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2e0e0-24ef-4558-ad87-e0294bae91f4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:12.644704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10cfb2-e4e8-464c-9034-ab460b5b4b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:12.645353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10cfb2-e4e8-464c-9034-ab460b5b4b77 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:12.645634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10cfb2-e4e8-464c-9034-ab460b5b4b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:12.645906 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10cfb2-e4e8-464c-9034-ab460b5b4b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:12.649142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ae10cfb2-e4e8-464c-9034-ab460b5b4b77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:12.650436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8daa-9d93-4932-9e0a-f87a154d6fb6 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:12.651783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-071c8daa-9d93-4932-9e0a-f87a154d6fb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:12.763121 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:12.796574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c8daa-9d93-4932-9e0a-f87a154d6fb6 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:12.797861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10cfb2-e4e8-464c-9034-ab460b5b4b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:12.799630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10cfb2-e4e8-464c-9034-ab460b5b4b77 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:12.812963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:12.813693 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:12.813936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:12.814207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] PATH_INFO: `/v3/projects/90a0bed47b544e86b45f7acfb65fe0e1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:12.816430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a0bed47b544e86b45f7acfb65fe0e1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:12.818593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:12.822305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1079/2195] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:12.901806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a0bed47b544e86b45f7acfb65fe0e1', 'request_id': 'req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:12.910810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a0bed47b544e86b45f7acfb65fe0e1', 'request_id': 'req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:12.937158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a0bed47b544e86b45f7acfb65fe0e1', 'request_id': 'req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:12.957260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] The token cache is being invalidate because project 90a0bed47b544e86b45f7acfb65fe0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:12.957771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:12.960459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:12.965081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1117/2196] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:12 2022] DELETE /identity/v3/projects/90a0bed47b544e86b45f7acfb65fe0e1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:12.969873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10cfb2-e4e8-464c-9034-ab460b5b4b77 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:12.988243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10cfb2-e4e8-464c-9034-ab460b5b4b77 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:13.068082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:13.094437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:13.095917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:13.096368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:13.096801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] PATH_INFO: `/v3/users/47f086bec9e3487fa185a5519123fa92` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:13.100864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f086bec9e3487fa185a5519123fa92)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:13.103052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:13.174380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f086bec9e3487fa185a5519123fa92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:13.184452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f086bec9e3487fa185a5519123fa92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:13.185423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f086bec9e3487fa185a5519123fa92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:13.211272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f086bec9e3487fa185a5519123fa92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:13.212447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f086bec9e3487fa185a5519123fa92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:13.252321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1080/2197] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:12 2022] DELETE /identity/v3/users/47f086bec9e3487fa185a5519123fa92 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:13.614508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:13.616574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:13.648646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cc08b-edc5-49b6-a59e-57bb3f5591b2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:13.775135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:13.775710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:13.775998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:13.776273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] PATH_INFO: `/v3/projects/0012d250187b4d72ad8ebc0bea9ba680` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:13.786501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0012d250187b4d72ad8ebc0bea9ba680)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:13.788543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:13.905269 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:13.907006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:13.918369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0012d250187b4d72ad8ebc0bea9ba680', 'request_id': 'req-4fc8c410-1f05-4816-8520-3494cef2329f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:13.926736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0012d250187b4d72ad8ebc0bea9ba680', 'request_id': 'req-4fc8c410-1f05-4816-8520-3494cef2329f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:13.968564 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0012d250187b4d72ad8ebc0bea9ba680', 'request_id': 'req-4fc8c410-1f05-4816-8520-3494cef2329f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:13.993455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] The token cache is being invalidate because project 0012d250187b4d72ad8ebc0bea9ba680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:13.993803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:13.996725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:13.999828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1118/2198] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:13 2022] DELETE /identity/v3/projects/0012d250187b4d72ad8ebc0bea9ba680 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:14.201883 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0f0ee-2eec-4638-99b9-c0b6339e9048 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:14.323857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cf2e3-82d3-4035-a0fd-e66846c1e313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:14.324973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cf2e3-82d3-4035-a0fd-e66846c1e313 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:14.325590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cf2e3-82d3-4035-a0fd-e66846c1e313 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:14.326238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cf2e3-82d3-4035-a0fd-e66846c1e313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:14.331465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-288cf2e3-82d3-4035-a0fd-e66846c1e313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:14.385104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:14.423492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cf2e3-82d3-4035-a0fd-e66846c1e313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:14.424980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cf2e3-82d3-4035-a0fd-e66846c1e313 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:14.438935 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1081/2199] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:11:15.378909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:15.380995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:15.398032 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8c410-1f05-4816-8520-3494cef2329f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:15.403722 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ddd29-026c-4d76-9748-6f8ae1120b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:15.404500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ddd29-026c-4d76-9748-6f8ae1120b36 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:15.405720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ddd29-026c-4d76-9748-6f8ae1120b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:15.405720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ddd29-026c-4d76-9748-6f8ae1120b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:15.407621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7f1ddd29-026c-4d76-9748-6f8ae1120b36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:15.416026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:15.516104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ddd29-026c-4d76-9748-6f8ae1120b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:15.520329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1ddd29-026c-4d76-9748-6f8ae1120b36 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:15.550592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1119/2200] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:11:16.121306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e7ede-c335-479f-a13f-25619d4bf16a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:16.121776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e7ede-c335-479f-a13f-25619d4bf16a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:16.121863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e7ede-c335-479f-a13f-25619d4bf16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:16.179342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ca7e7ede-c335-479f-a13f-25619d4bf16a None None] MFA Rules not processed for user `ca12607363574ef0a0a721533e676824`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:16.180593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca7e7ede-c335-479f-a13f-25619d4bf16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:16.257503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1082/2201] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:16.272831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ddd29-026c-4d76-9748-6f8ae1120b36 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:16.274341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7f1ddd29-026c-4d76-9748-6f8ae1120b36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:16.356355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ddd29-026c-4d76-9748-6f8ae1120b36 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:16.362153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2db29-eeb9-49ad-bfc1-76837bf5b952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:16.362841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2db29-eeb9-49ad-bfc1-76837bf5b952 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:16.363127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2db29-eeb9-49ad-bfc1-76837bf5b952 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:16.363456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2db29-eeb9-49ad-bfc1-76837bf5b952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:16.372585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2db29-eeb9-49ad-bfc1-76837bf5b952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:16.374291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d2db29-eeb9-49ad-bfc1-76837bf5b952 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:16.385108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1120/2202] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:11:17.068778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e7ede-c335-479f-a13f-25619d4bf16a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:17.070634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca7e7ede-c335-479f-a13f-25619d4bf16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:17.267416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e7ede-c335-479f-a13f-25619d4bf16a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:17.272519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:17.273389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:17.273863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:17.274299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] PATH_INFO: `/v3/users/7d3000179082472db7c8bd33c0279aa9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:17.275571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3000179082472db7c8bd33c0279aa9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:17.277771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:17.356580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3000179082472db7c8bd33c0279aa9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:17.377650 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3000179082472db7c8bd33c0279aa9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:17.379177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3000179082472db7c8bd33c0279aa9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:17.390738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3000179082472db7c8bd33c0279aa9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:17.391724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3000179082472db7c8bd33c0279aa9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:17.397331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:17.432842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1083/2203] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:17 2022] DELETE /identity/v3/users/7d3000179082472db7c8bd33c0279aa9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:17.437259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dc037-f547-4747-acac-aada8ffc3468 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:17.437730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dc037-f547-4747-acac-aada8ffc3468 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:17.437834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dc037-f547-4747-acac-aada8ffc3468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:17.468228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-504dc037-f547-4747-acac-aada8ffc3468 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:17.469891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-504dc037-f547-4747-acac-aada8ffc3468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:17.560960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1121/2204] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:17.570892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:17.572365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:17.646708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02049e29-0ea2-42c9-9d2e-c1787ae5700c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:17.651931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d237ad-7555-4312-ac09-4db6c9eb5e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:17.653213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d237ad-7555-4312-ac09-4db6c9eb5e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:17.653213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d237ad-7555-4312-ac09-4db6c9eb5e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:17.653484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d237ad-7555-4312-ac09-4db6c9eb5e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:17.666023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d237ad-7555-4312-ac09-4db6c9eb5e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:17.667631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d237ad-7555-4312-ac09-4db6c9eb5e68 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:17.685241 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1084/2205] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:17.989366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dc037-f547-4747-acac-aada8ffc3468 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:17.991518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-504dc037-f547-4747-acac-aada8ffc3468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:18.012825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dc037-f547-4747-acac-aada8ffc3468 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:18.019560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:18.020537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:18.020962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:18.021394 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] PATH_INFO: `/v3/projects/74ff6257287b4f108e2a54c24efafe2c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:18.023439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ff6257287b4f108e2a54c24efafe2c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:18.028727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:18.072387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:18.105759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ff6257287b4f108e2a54c24efafe2c', 'request_id': 'req-44972d5f-34d2-4a76-9572-80b294e321ec'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:18.111796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ff6257287b4f108e2a54c24efafe2c', 'request_id': 'req-44972d5f-34d2-4a76-9572-80b294e321ec'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:18.121308 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ff6257287b4f108e2a54c24efafe2c', 'request_id': 'req-44972d5f-34d2-4a76-9572-80b294e321ec'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:18.136801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] The token cache is being invalidate because project 74ff6257287b4f108e2a54c24efafe2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:18.137432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:18.138820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-44972d5f-34d2-4a76-9572-80b294e321ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:18.140517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1122/2206] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:17 2022] DELETE /identity/v3/projects/74ff6257287b4f108e2a54c24efafe2c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:18.144742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d237ad-7555-4312-ac09-4db6c9eb5e68 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:18.155290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d237ad-7555-4312-ac09-4db6c9eb5e68 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:18.231963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:18.232931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:18.233563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:18.234117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] PATH_INFO: `/v3/users/351013d1b3f241ec9d8c695a4beea66a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:18.235363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=351013d1b3f241ec9d8c695a4beea66a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:18.237409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:18.301471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351013d1b3f241ec9d8c695a4beea66a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:18.312601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351013d1b3f241ec9d8c695a4beea66a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:18.313684 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351013d1b3f241ec9d8c695a4beea66a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:18.326453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351013d1b3f241ec9d8c695a4beea66a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:18.326453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351013d1b3f241ec9d8c695a4beea66a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:18.344376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1085/2207] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:18 2022] DELETE /identity/v3/users/351013d1b3f241ec9d8c695a4beea66a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:11:18.491019 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eea64f-119c-487e-ab37-af437c55879f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:18.491487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eea64f-119c-487e-ab37-af437c55879f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:18.493563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eea64f-119c-487e-ab37-af437c55879f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:18.547989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-58eea64f-119c-487e-ab37-af437c55879f None None] MFA Rules not processed for user `ca12607363574ef0a0a721533e676824`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:18.553158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-58eea64f-119c-487e-ab37-af437c55879f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:18.704747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1123/2208] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:18.877317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:18.878941 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:18.886411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:19.010438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffcf41-f3bb-4d09-a9f8-f791118ec17a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:19.015721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:19.016377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:19.016654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:19.016925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] PATH_INFO: `/v3/projects/25fbbc60b004421fb06db529377575f0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:19.018272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=25fbbc60b004421fb06db529377575f0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:19.020648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:19.113717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25fbbc60b004421fb06db529377575f0', 'request_id': 'req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:19.120575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25fbbc60b004421fb06db529377575f0', 'request_id': 'req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:19.137551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25fbbc60b004421fb06db529377575f0', 'request_id': 'req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:19.161679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] The token cache is being invalidate because project 25fbbc60b004421fb06db529377575f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:19.162183 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:19.163525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bdca8dd-8eb7-4398-bcff-8400a8a0e6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:19.170084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1086/2209] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:18 2022] DELETE /identity/v3/projects/25fbbc60b004421fb06db529377575f0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:19.171572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd2f5-da9b-417e-9db8-ad9780e791a1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:19.172022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd2f5-da9b-417e-9db8-ad9780e791a1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:19.173831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd2f5-da9b-417e-9db8-ad9780e791a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:19.214414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-230bd2f5-da9b-417e-9db8-ad9780e791a1 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:19.215664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-230bd2f5-da9b-417e-9db8-ad9780e791a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:19.281902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1124/2210] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:19.289803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435d2bb-8dee-4dfb-8aed-8552c6bf1ceb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:19.290094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435d2bb-8dee-4dfb-8aed-8552c6bf1ceb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:19.290372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435d2bb-8dee-4dfb-8aed-8552c6bf1ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:19.310765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9435d2bb-8dee-4dfb-8aed-8552c6bf1ceb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:19.312315 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9435d2bb-8dee-4dfb-8aed-8552c6bf1ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:19.320784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1087/2211] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:19.325129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd2f5-da9b-417e-9db8-ad9780e791a1 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:19.335322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd2f5-da9b-417e-9db8-ad9780e791a1 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:19.341858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5cab1-ef70-45ce-a2c3-da521d7e11e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:19.342914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5cab1-ef70-45ce-a2c3-da521d7e11e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:19.342914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5cab1-ef70-45ce-a2c3-da521d7e11e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:19.343121 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5cab1-ef70-45ce-a2c3-da521d7e11e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:19.344349 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5cab1-ef70-45ce-a2c3-da521d7e11e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:19.344660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5cab1-ef70-45ce-a2c3-da521d7e11e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:19.346527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5cab1-ef70-45ce-a2c3-da521d7e11e6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:19.361066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1125/2212] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:11:19.368411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435d2bb-8dee-4dfb-8aed-8552c6bf1ceb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:19.375774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435d2bb-8dee-4dfb-8aed-8552c6bf1ceb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:19.381450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bcbdc-f8af-4c2d-aac2-ef25a0d3c4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:19.381727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bcbdc-f8af-4c2d-aac2-ef25a0d3c4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:19.382003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bcbdc-f8af-4c2d-aac2-ef25a0d3c4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:19.382272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bcbdc-f8af-4c2d-aac2-ef25a0d3c4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:19.382908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bcbdc-f8af-4c2d-aac2-ef25a0d3c4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:19.384896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bcbdc-f8af-4c2d-aac2-ef25a0d3c4a3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:19.420070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1088/2213] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:19 2022] POST /identity/v3/projects => generated 409 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:19.420702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5cab1-ef70-45ce-a2c3-da521d7e11e6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:19.431552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5cab1-ef70-45ce-a2c3-da521d7e11e6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:19.505345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:19.540622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78475158-f3eb-422a-9f1a-53806c8d8853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:19.541590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78475158-f3eb-422a-9f1a-53806c8d8853 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:19.542207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78475158-f3eb-422a-9f1a-53806c8d8853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:19.542643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78475158-f3eb-422a-9f1a-53806c8d8853 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:19.543443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78475158-f3eb-422a-9f1a-53806c8d8853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:19.545588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78475158-f3eb-422a-9f1a-53806c8d8853 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:19.642280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1126/2214] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:19 2022] POST /identity/v3/users => generated 305 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:11:19.645525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bcbdc-f8af-4c2d-aac2-ef25a0d3c4a3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:19.681729 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bcbdc-f8af-4c2d-aac2-ef25a0d3c4a3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:19.697837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413a0f3-5e7c-42fc-b518-8c2b5dbc3be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:19.699257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a0f3-5e7c-42fc-b518-8c2b5dbc3be2 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:19.699601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a0f3-5e7c-42fc-b518-8c2b5dbc3be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:19.700873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413a0f3-5e7c-42fc-b518-8c2b5dbc3be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:19.703709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413a0f3-5e7c-42fc-b518-8c2b5dbc3be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:19.707577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413a0f3-5e7c-42fc-b518-8c2b5dbc3be2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:19.740271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1089/2215] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:19.743872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78475158-f3eb-422a-9f1a-53806c8d8853 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:19.755169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78475158-f3eb-422a-9f1a-53806c8d8853 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:19.762029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ea730-ffce-48fa-89e1-0c3dac876ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:19.762653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ea730-ffce-48fa-89e1-0c3dac876ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:19.763119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ea730-ffce-48fa-89e1-0c3dac876ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:19.763541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ea730-ffce-48fa-89e1-0c3dac876ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:19.765061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ea730-ffce-48fa-89e1-0c3dac876ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:19.766953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ea730-ffce-48fa-89e1-0c3dac876ac6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:19.789837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413a0f3-5e7c-42fc-b518-8c2b5dbc3be2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:19.806428 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413a0f3-5e7c-42fc-b518-8c2b5dbc3be2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:19.807403 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1127/2216] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:11:19.812588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a859882-6ddb-49f1-b1e1-53bbd0f1f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:19.813380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a859882-6ddb-49f1-b1e1-53bbd0f1f1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:19.813737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a859882-6ddb-49f1-b1e1-53bbd0f1f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:19.814101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a859882-6ddb-49f1-b1e1-53bbd0f1f1fc admin admin] PATH_INFO: `/v3/projects/86b6f4f833c04682bb4a6f812d1b01ec/users/33462747b97d4364b7ed9e25ef5a3e1e/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:19.896989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a859882-6ddb-49f1-b1e1-53bbd0f1f1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b6f4f833c04682bb4a6f812d1b01ec, user_id=33462747b97d4364b7ed9e25ef5a3e1e, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:19.903933 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a859882-6ddb-49f1-b1e1-53bbd0f1f1fc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:19.918951 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ea730-ffce-48fa-89e1-0c3dac876ac6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:19.920786 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b28ea730-ffce-48fa-89e1-0c3dac876ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:19.943517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1090/2217] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:19 2022] PUT /identity/v3/projects/86b6f4f833c04682bb4a6f812d1b01ec/users/33462747b97d4364b7ed9e25ef5a3e1e/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:19.966851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53f15a-d05c-42bc-8dca-5e8248b0e2a0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:19.967138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53f15a-d05c-42bc-8dca-5e8248b0e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:19.967416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53f15a-d05c-42bc-8dca-5e8248b0e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:19.989123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ea730-ffce-48fa-89e1-0c3dac876ac6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:20.030017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7e53f15a-d05c-42bc-8dca-5e8248b0e2a0 None None] MFA Rules not processed for user `33462747b97d4364b7ed9e25ef5a3e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:20.033449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7e53f15a-d05c-42bc-8dca-5e8248b0e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:20.061855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:20.079482 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:20.080472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:20.081815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:20.082495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] PATH_INFO: `/v3/users/80e6034ebd0b465c9abd3fb0bcfe04e3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:20.085382 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e6034ebd0b465c9abd3fb0bcfe04e3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:20.087666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:20.173205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1091/2218] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:19 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:11:20.173404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e6034ebd0b465c9abd3fb0bcfe04e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:20.173404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e6034ebd0b465c9abd3fb0bcfe04e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:20.176339 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53f15a-d05c-42bc-8dca-5e8248b0e2a0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:20.198337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e6034ebd0b465c9abd3fb0bcfe04e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:20.201071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53f15a-d05c-42bc-8dca-5e8248b0e2a0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:20.213636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460705c0-1dfa-456b-a58b-3ecd95ec498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:20.214432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460705c0-1dfa-456b-a58b-3ecd95ec498c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:20.215014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460705c0-1dfa-456b-a58b-3ecd95ec498c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:20.215868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460705c0-1dfa-456b-a58b-3ecd95ec498c admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:20.216835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460705c0-1dfa-456b-a58b-3ecd95ec498c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:20.219551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460705c0-1dfa-456b-a58b-3ecd95ec498c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:20.226279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e6034ebd0b465c9abd3fb0bcfe04e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:20.227294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f9dc9d4c-a52c-4e3f-809f-8dc0b2411700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e6034ebd0b465c9abd3fb0bcfe04e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:20.250438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1128/2219] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:19 2022] DELETE /identity/v3/users/80e6034ebd0b465c9abd3fb0bcfe04e3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:11:20.256173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70fb6e-1ee4-47ed-a9ba-adb3cf5728b3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:20.256780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70fb6e-1ee4-47ed-a9ba-adb3cf5728b3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:20.257659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70fb6e-1ee4-47ed-a9ba-adb3cf5728b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:20.313409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1092/2220] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:20 2022] POST /identity/v3/projects => generated 409 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:20.319952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460705c0-1dfa-456b-a58b-3ecd95ec498c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:20.322575 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-460705c0-1dfa-456b-a58b-3ecd95ec498c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:20.329946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9b70fb6e-1ee4-47ed-a9ba-adb3cf5728b3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:20.331192 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b70fb6e-1ee4-47ed-a9ba-adb3cf5728b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:20.405273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:20.454111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1129/2221] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:20.464877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70fb6e-1ee4-47ed-a9ba-adb3cf5728b3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:20.470199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b70fb6e-1ee4-47ed-a9ba-adb3cf5728b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:20.500132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460705c0-1dfa-456b-a58b-3ecd95ec498c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:20.505324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da7f6-c142-4d7d-b73d-920f44dd3a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:20.506289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da7f6-c142-4d7d-b73d-920f44dd3a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:20.506570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da7f6-c142-4d7d-b73d-920f44dd3a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:20.506841 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da7f6-c142-4d7d-b73d-920f44dd3a8b admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:20.507485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76da7f6-c142-4d7d-b73d-920f44dd3a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:20.509479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76da7f6-c142-4d7d-b73d-920f44dd3a8b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:20.541080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1093/2222] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:20 2022] POST /identity/v3/users => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:20.544862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da7f6-c142-4d7d-b73d-920f44dd3a8b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:20.560218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da7f6-c142-4d7d-b73d-920f44dd3a8b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:20.576526 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110727d-20a8-4d08-9be4-db3e88d11569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:20.577190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110727d-20a8-4d08-9be4-db3e88d11569 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:20.577500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110727d-20a8-4d08-9be4-db3e88d11569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:20.577812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110727d-20a8-4d08-9be4-db3e88d11569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:20.580452 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110727d-20a8-4d08-9be4-db3e88d11569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:20.580604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110727d-20a8-4d08-9be4-db3e88d11569 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:20.594516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1094/2223] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:20.598662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110727d-20a8-4d08-9be4-db3e88d11569 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:20.610450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70fb6e-1ee4-47ed-a9ba-adb3cf5728b3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:20.611290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110727d-20a8-4d08-9be4-db3e88d11569 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:20.622183 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0778c22-17dc-48ee-933f-7fbd21b467a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:20.622890 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0778c22-17dc-48ee-933f-7fbd21b467a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:20.623175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0778c22-17dc-48ee-933f-7fbd21b467a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:20.623498 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0778c22-17dc-48ee-933f-7fbd21b467a6 admin admin] PATH_INFO: `/v3/projects/1158215302bc4cd38ea34f772f87ed1f/users/680ef0be02ff48fbbf6e38bc65dc1520/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:20.640397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be36ba-5d31-4087-a4ba-b6794331ab05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:20.641384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be36ba-5d31-4087-a4ba-b6794331ab05 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:20.642369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be36ba-5d31-4087-a4ba-b6794331ab05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:20.642666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be36ba-5d31-4087-a4ba-b6794331ab05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:20.643617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0778c22-17dc-48ee-933f-7fbd21b467a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1158215302bc4cd38ea34f772f87ed1f, user_id=680ef0be02ff48fbbf6e38bc65dc1520, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:20.647181 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0778c22-17dc-48ee-933f-7fbd21b467a6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:20.662962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be36ba-5d31-4087-a4ba-b6794331ab05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:20.666352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be36ba-5d31-4087-a4ba-b6794331ab05 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:20.683875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1130/2224] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:20.711450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1095/2225] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:20 2022] PUT /identity/v3/projects/1158215302bc4cd38ea34f772f87ed1f/users/680ef0be02ff48fbbf6e38bc65dc1520/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:11:20.715079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be36ba-5d31-4087-a4ba-b6794331ab05 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:20.734668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be36ba-5d31-4087-a4ba-b6794331ab05 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:20.849675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc65090-ae36-472a-9f1c-19b9325eeaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:20.850614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65090-ae36-472a-9f1c-19b9325eeaaf admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:20.852451 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65090-ae36-472a-9f1c-19b9325eeaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:20.855391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc65090-ae36-472a-9f1c-19b9325eeaaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:20.856431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc65090-ae36-472a-9f1c-19b9325eeaaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:20.859516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc65090-ae36-472a-9f1c-19b9325eeaaf admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:20.890166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1131/2226] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:11:20.894664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0778c22-17dc-48ee-933f-7fbd21b467a6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:20.911527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0778c22-17dc-48ee-933f-7fbd21b467a6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:20.919755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cc842-c446-4aee-a5dd-d63880b904d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:20.920537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc842-c446-4aee-a5dd-d63880b904d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:20.920982 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc842-c446-4aee-a5dd-d63880b904d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:20.921486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cc842-c446-4aee-a5dd-d63880b904d0 admin admin] PATH_INFO: `/v3/projects/1158215302bc4cd38ea34f772f87ed1f/users/680ef0be02ff48fbbf6e38bc65dc1520/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:20.924091 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cc842-c446-4aee-a5dd-d63880b904d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1158215302bc4cd38ea34f772f87ed1f, user_id=680ef0be02ff48fbbf6e38bc65dc1520, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:20.927446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cc842-c446-4aee-a5dd-d63880b904d0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:20.947962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1096/2227] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:20 2022] PUT /identity/v3/projects/1158215302bc4cd38ea34f772f87ed1f/users/680ef0be02ff48fbbf6e38bc65dc1520/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:20.958190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391dadd-31bb-40a2-97c7-46778c6a2384 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:20.958493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391dadd-31bb-40a2-97c7-46778c6a2384 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:20.958774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391dadd-31bb-40a2-97c7-46778c6a2384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:20.997921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a391dadd-31bb-40a2-97c7-46778c6a2384 None None] MFA Rules not processed for user `680ef0be02ff48fbbf6e38bc65dc1520`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:20.999430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a391dadd-31bb-40a2-97c7-46778c6a2384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:21.108661 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cc842-c446-4aee-a5dd-d63880b904d0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:21.110897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-614cc842-c446-4aee-a5dd-d63880b904d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:21.168048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1132/2228] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:20 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:21.182606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391dadd-31bb-40a2-97c7-46778c6a2384 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:21.189532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a391dadd-31bb-40a2-97c7-46778c6a2384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:21.200117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:21.225950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:21.260826 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391dadd-31bb-40a2-97c7-46778c6a2384 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:21.261186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cc842-c446-4aee-a5dd-d63880b904d0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:21.264961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa83c18-8c51-4a84-ba9a-dae22e1d3ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:21.265708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa83c18-8c51-4a84-ba9a-dae22e1d3ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:21.266108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa83c18-8c51-4a84-ba9a-dae22e1d3ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:21.266446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa83c18-8c51-4a84-ba9a-dae22e1d3ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:21.268772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:21.269827 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:21.270276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:21.270787 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] PATH_INFO: `/v3/projects/7630d747ab304dce915e6cdec0720d41` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:21.273801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7630d747ab304dce915e6cdec0720d41)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:21.275814 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:21.286617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa83c18-8c51-4a84-ba9a-dae22e1d3ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:21.288075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa83c18-8c51-4a84-ba9a-dae22e1d3ec7 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:21.301175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1133/2229] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:21 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:21.338333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7630d747ab304dce915e6cdec0720d41', 'request_id': 'req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:21.345908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7630d747ab304dce915e6cdec0720d41', 'request_id': 'req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:21.358366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7630d747ab304dce915e6cdec0720d41', 'request_id': 'req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:21.376272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] The token cache is being invalidate because project 7630d747ab304dce915e6cdec0720d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:21.376577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:21.377313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:21.378900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1097/2230] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:21 2022] DELETE /identity/v3/projects/7630d747ab304dce915e6cdec0720d41 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:21.383339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa83c18-8c51-4a84-ba9a-dae22e1d3ec7 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:21.394242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa83c18-8c51-4a84-ba9a-dae22e1d3ec7 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:21.468167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:21.468827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:21.469141 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:21.469424 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] PATH_INFO: `/v3/users/7695aba975eb490692d7394748b56668` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:21.473360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7695aba975eb490692d7394748b56668)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:21.473360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:21.496756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:21.499064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:21.551563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7695aba975eb490692d7394748b56668'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:21.552491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7695aba975eb490692d7394748b56668'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:21.571070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7695aba975eb490692d7394748b56668'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:21.582809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7695aba975eb490692d7394748b56668'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:21.584572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7695aba975eb490692d7394748b56668'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:21.616900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1134/2231] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:21 2022] DELETE /identity/v3/users/7695aba975eb490692d7394748b56668 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:21.637880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5ec8-edc6-486a-b2f4-ede3c1fbc3e8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:21.773353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa2284-ef2f-4eda-aff9-866a7804aabb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:21.773963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa2284-ef2f-4eda-aff9-866a7804aabb service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:21.774407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa2284-ef2f-4eda-aff9-866a7804aabb service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:21.774722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa2284-ef2f-4eda-aff9-866a7804aabb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:21.785649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2cfa2284-ef2f-4eda-aff9-866a7804aabb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:21.908019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:21.981168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa2284-ef2f-4eda-aff9-866a7804aabb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:21.983447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa2284-ef2f-4eda-aff9-866a7804aabb service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:21.999395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1098/2232] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:21 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:22.114478 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:22.117492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:22.177909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:22.223644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6061e9-f7fd-4d43-87d3-d91649239d29 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:22.229663 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:22.230323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:22.230727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:22.231039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] PATH_INFO: `/v3/projects/7095524e7228441f99b920652308ca90` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:22.232201 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7095524e7228441f99b920652308ca90)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:22.234741 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:22.292380 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7095524e7228441f99b920652308ca90', 'request_id': 'req-1843c79d-3735-408d-ab60-27296132fa36'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:22.298684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7095524e7228441f99b920652308ca90', 'request_id': 'req-1843c79d-3735-408d-ab60-27296132fa36'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:22.314648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7095524e7228441f99b920652308ca90', 'request_id': 'req-1843c79d-3735-408d-ab60-27296132fa36'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:22.337682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] The token cache is being invalidate because project 7095524e7228441f99b920652308ca90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:22.338644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:22.339819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:22.342714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1135/2233] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:22 2022] DELETE /identity/v3/projects/7095524e7228441f99b920652308ca90 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:22.347094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa2284-ef2f-4eda-aff9-866a7804aabb service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:22.373665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa2284-ef2f-4eda-aff9-866a7804aabb service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:22.490131 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:22.491721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:22.492152 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:22.492535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] PATH_INFO: `/v3/users/7535d461a8e44f4c839785386700e24e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:22.493992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7535d461a8e44f4c839785386700e24e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:22.497325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:22.572945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7535d461a8e44f4c839785386700e24e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:22.579862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7535d461a8e44f4c839785386700e24e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:22.580518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7535d461a8e44f4c839785386700e24e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:22.588411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7535d461a8e44f4c839785386700e24e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:22.589019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-771d4ccc-a130-4994-8c16-65d084020305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7535d461a8e44f4c839785386700e24e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:22.609328 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1099/2234] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:22 2022] DELETE /identity/v3/users/7535d461a8e44f4c839785386700e24e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:23.001577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:23.003812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:23.026842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843c79d-3735-408d-ab60-27296132fa36 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:23.102333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:23.102987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:23.103277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:23.103534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] PATH_INFO: `/v3/projects/20347154711c46ada1b4606dc38ec7ab` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:23.104783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20347154711c46ada1b4606dc38ec7ab)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:23.106824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:23.177984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20347154711c46ada1b4606dc38ec7ab', 'request_id': 'req-314458c1-2a94-4d20-b2a8-0a4656a80a1d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:23.187161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20347154711c46ada1b4606dc38ec7ab', 'request_id': 'req-314458c1-2a94-4d20-b2a8-0a4656a80a1d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:23.190219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:23.197945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20347154711c46ada1b4606dc38ec7ab', 'request_id': 'req-314458c1-2a94-4d20-b2a8-0a4656a80a1d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:23.217074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] The token cache is being invalidate because project 20347154711c46ada1b4606dc38ec7ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:23.217393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:23.218152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-314458c1-2a94-4d20-b2a8-0a4656a80a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:23.221124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1136/2235] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:23 2022] DELETE /identity/v3/projects/20347154711c46ada1b4606dc38ec7ab => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:23.227292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07d068-13fe-4793-ab36-38a774b5865e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:23.227292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07d068-13fe-4793-ab36-38a774b5865e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:23.227592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07d068-13fe-4793-ab36-38a774b5865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:23.256463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0b07d068-13fe-4793-ab36-38a774b5865e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:23.258674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0b07d068-13fe-4793-ab36-38a774b5865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:23.342954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:23.364782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1100/2236] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:23.368754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d1548-d07f-4cd8-b504-58ebc3c1d1e8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:23.369207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d1548-d07f-4cd8-b504-58ebc3c1d1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:23.370181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d1548-d07f-4cd8-b504-58ebc3c1d1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:23.399381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-802d1548-d07f-4cd8-b504-58ebc3c1d1e8 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:23.401516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-802d1548-d07f-4cd8-b504-58ebc3c1d1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:23.411009 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1137/2237] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:23.417803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07d068-13fe-4793-ab36-38a774b5865e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:23.432008 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07d068-13fe-4793-ab36-38a774b5865e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:23.437279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1d905-deca-4674-a197-dcafe4ddc086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:23.437921 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1d905-deca-4674-a197-dcafe4ddc086 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:23.438211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1d905-deca-4674-a197-dcafe4ddc086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:23.438460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1d905-deca-4674-a197-dcafe4ddc086 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:23.439253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1d905-deca-4674-a197-dcafe4ddc086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:23.439414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1d905-deca-4674-a197-dcafe4ddc086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:23.441153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1d905-deca-4674-a197-dcafe4ddc086 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:23.454950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1101/2238] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:11:23.468606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d1548-d07f-4cd8-b504-58ebc3c1d1e8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:23.480214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d1548-d07f-4cd8-b504-58ebc3c1d1e8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:23.485055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c8cb-0182-451a-be2f-3a9c5b5e2953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:23.485857 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c8cb-0182-451a-be2f-3a9c5b5e2953 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:23.486232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c8cb-0182-451a-be2f-3a9c5b5e2953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:23.486648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c8cb-0182-451a-be2f-3a9c5b5e2953 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:23.487416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228c8cb-0182-451a-be2f-3a9c5b5e2953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:23.490278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228c8cb-0182-451a-be2f-3a9c5b5e2953 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:23.559461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1138/2239] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:23 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:23.560429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1d905-deca-4674-a197-dcafe4ddc086 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:23.575988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1d905-deca-4674-a197-dcafe4ddc086 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:23.718771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196e4f7-fd38-415d-afc7-77ca5bd353b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:23.719390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196e4f7-fd38-415d-afc7-77ca5bd353b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:23.719675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196e4f7-fd38-415d-afc7-77ca5bd353b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:23.719946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196e4f7-fd38-415d-afc7-77ca5bd353b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:23.721988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196e4f7-fd38-415d-afc7-77ca5bd353b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:23.722630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196e4f7-fd38-415d-afc7-77ca5bd353b3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:23.778891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1102/2240] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:23 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:23.783309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c8cb-0182-451a-be2f-3a9c5b5e2953 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:23.803553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c8cb-0182-451a-be2f-3a9c5b5e2953 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:23.829764 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9169d-7967-4bb4-93f9-1e0726597b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:23.831289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9169d-7967-4bb4-93f9-1e0726597b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:23.831771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9169d-7967-4bb4-93f9-1e0726597b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:23.834910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9169d-7967-4bb4-93f9-1e0726597b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:23.836008 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9169d-7967-4bb4-93f9-1e0726597b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:23.837727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9169d-7967-4bb4-93f9-1e0726597b86 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:23.859720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1139/2241] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:23.862710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196e4f7-fd38-415d-afc7-77ca5bd353b3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:23.875210 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196e4f7-fd38-415d-afc7-77ca5bd353b3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:23.882374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b2cd5-bb7e-4a4d-9a2c-c148214494f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:23.883110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b2cd5-bb7e-4a4d-9a2c-c148214494f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:23.883403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b2cd5-bb7e-4a4d-9a2c-c148214494f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:23.883669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b2cd5-bb7e-4a4d-9a2c-c148214494f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:23.884334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b2cd5-bb7e-4a4d-9a2c-c148214494f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:23.886023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b2cd5-bb7e-4a4d-9a2c-c148214494f1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:23.901077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1103/2242] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:11:23.903917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9169d-7967-4bb4-93f9-1e0726597b86 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:23.916026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9169d-7967-4bb4-93f9-1e0726597b86 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:23.923809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3c722-ea89-43a6-a125-69d26fb75e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:23.924870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3c722-ea89-43a6-a125-69d26fb75e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:23.925401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3c722-ea89-43a6-a125-69d26fb75e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:23.925771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3c722-ea89-43a6-a125-69d26fb75e41 admin admin] PATH_INFO: `/v3/projects/c055c30c3b0447549f4df91e1f1b2f15/users/020bfde7f4cc45a7abab29f1952970f1/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:23.943063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3c722-ea89-43a6-a125-69d26fb75e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c055c30c3b0447549f4df91e1f1b2f15, user_id=020bfde7f4cc45a7abab29f1952970f1, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:23.946243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3c722-ea89-43a6-a125-69d26fb75e41 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:23.962442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1140/2243] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:23 2022] PUT /identity/v3/projects/c055c30c3b0447549f4df91e1f1b2f15/users/020bfde7f4cc45a7abab29f1952970f1/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:23.974073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2463d-75f1-489f-923e-74775763cf60 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:23.974484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2463d-75f1-489f-923e-74775763cf60 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:23.974824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2463d-75f1-489f-923e-74775763cf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:24.008868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1dc2463d-75f1-489f-923e-74775763cf60 None None] MFA Rules not processed for user `020bfde7f4cc45a7abab29f1952970f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:24.010178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1dc2463d-75f1-489f-923e-74775763cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:24.083772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1104/2244] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:24.095740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3c722-ea89-43a6-a125-69d26fb75e41 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:24.098957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f7b3c722-ea89-43a6-a125-69d26fb75e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:24.170864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3c722-ea89-43a6-a125-69d26fb75e41 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:24.174540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd01e4b-678f-44f8-946c-52dd73691c04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:24.175189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01e4b-678f-44f8-946c-52dd73691c04 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:24.175471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01e4b-678f-44f8-946c-52dd73691c04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:24.175746 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd01e4b-678f-44f8-946c-52dd73691c04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:24.184331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd01e4b-678f-44f8-946c-52dd73691c04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:24.185811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd01e4b-678f-44f8-946c-52dd73691c04 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:24.196494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1141/2245] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:26.592064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2463d-75f1-489f-923e-74775763cf60 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:26.593573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1dc2463d-75f1-489f-923e-74775763cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:26.658447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:26.665777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2463d-75f1-489f-923e-74775763cf60 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:26.671290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:26.671939 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:26.672219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:26.672512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] PATH_INFO: `/v3/users/c1ab7333e46a4f7bb37b79642df80bc1` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:26.673697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ab7333e46a4f7bb37b79642df80bc1)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:26.675695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:26.725512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ab7333e46a4f7bb37b79642df80bc1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:26.732410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ab7333e46a4f7bb37b79642df80bc1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:26.733145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ab7333e46a4f7bb37b79642df80bc1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:26.741626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ab7333e46a4f7bb37b79642df80bc1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:26.742243 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ab7333e46a4f7bb37b79642df80bc1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:26.760871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1105/2246] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:26 2022] DELETE /identity/v3/users/c1ab7333e46a4f7bb37b79642df80bc1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:26.765513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79313878-1ade-4401-8ff3-5918341ebf6b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:26.765989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79313878-1ade-4401-8ff3-5918341ebf6b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:26.766102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79313878-1ade-4401-8ff3-5918341ebf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:26.786420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-79313878-1ade-4401-8ff3-5918341ebf6b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:26.787221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-79313878-1ade-4401-8ff3-5918341ebf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:26.816478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:26.818471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:26.853937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1142/2247] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:26.864322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79313878-1ade-4401-8ff3-5918341ebf6b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:26.866211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-79313878-1ade-4401-8ff3-5918341ebf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:26.886887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db035bf-4354-4eb9-9638-cef209a63950 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:26.891752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:26.892411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:26.892691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:26.892957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] PATH_INFO: `/v3/users/020bfde7f4cc45a7abab29f1952970f1` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:26.894138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=020bfde7f4cc45a7abab29f1952970f1)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:26.896157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:26.900286 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:26.941320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79313878-1ade-4401-8ff3-5918341ebf6b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:26.947056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e602b-1fc5-46da-941f-87d19463cea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:26.948081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e602b-1fc5-46da-941f-87d19463cea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:26.948424 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e602b-1fc5-46da-941f-87d19463cea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:26.948766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e602b-1fc5-46da-941f-87d19463cea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:26.965289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020bfde7f4cc45a7abab29f1952970f1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:26.965506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e602b-1fc5-46da-941f-87d19463cea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:26.965506 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e602b-1fc5-46da-941f-87d19463cea5 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:26.979672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1143/2248] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:26.980799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020bfde7f4cc45a7abab29f1952970f1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:26.981574 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020bfde7f4cc45a7abab29f1952970f1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:26.990470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020bfde7f4cc45a7abab29f1952970f1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:26.991331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020bfde7f4cc45a7abab29f1952970f1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.004833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:27.016620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1106/2249] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:26 2022] DELETE /identity/v3/users/020bfde7f4cc45a7abab29f1952970f1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:27.021360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2faeb-4e76-4a47-9c5d-dca2a3af1161 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.021770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2faeb-4e76-4a47-9c5d-dca2a3af1161 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.022159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2faeb-4e76-4a47-9c5d-dca2a3af1161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:27.046067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-37f2faeb-4e76-4a47-9c5d-dca2a3af1161 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:27.048115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-37f2faeb-4e76-4a47-9c5d-dca2a3af1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:27.167102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1144/2250] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:27.178737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:27.180248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:27.263003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef4c85-fed0-4661-9cd1-a1a0d4c8d31c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:27.267304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41e5ba-48d0-4a93-b42d-479a9607cba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:27.268081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41e5ba-48d0-4a93-b42d-479a9607cba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.268430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41e5ba-48d0-4a93-b42d-479a9607cba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.269464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41e5ba-48d0-4a93-b42d-479a9607cba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:27.279052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41e5ba-48d0-4a93-b42d-479a9607cba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:27.280620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41e5ba-48d0-4a93-b42d-479a9607cba5 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:27.290975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1107/2251] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:27.394461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2faeb-4e76-4a47-9c5d-dca2a3af1161 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:27.396012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-37f2faeb-4e76-4a47-9c5d-dca2a3af1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:27.409136 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2faeb-4e76-4a47-9c5d-dca2a3af1161 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:27.414684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:27.415416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.415636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.415909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] PATH_INFO: `/v3/projects/094c0f15c1bc424ea22f3786c91fffc7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:27.417167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=094c0f15c1bc424ea22f3786c91fffc7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:27.419328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:27.470752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094c0f15c1bc424ea22f3786c91fffc7', 'request_id': 'req-91a5ee84-ea13-4bf6-b52c-072b888049ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.477446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094c0f15c1bc424ea22f3786c91fffc7', 'request_id': 'req-91a5ee84-ea13-4bf6-b52c-072b888049ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.499035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094c0f15c1bc424ea22f3786c91fffc7', 'request_id': 'req-91a5ee84-ea13-4bf6-b52c-072b888049ff'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.515372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] The token cache is being invalidate because project 094c0f15c1bc424ea22f3786c91fffc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:27.515683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.516364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-91a5ee84-ea13-4bf6-b52c-072b888049ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.521510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1145/2252] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:27 2022] DELETE /identity/v3/projects/094c0f15c1bc424ea22f3786c91fffc7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:27.524234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190cbdd-cfea-41fe-9f5b-60fd3524ade7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.524872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190cbdd-cfea-41fe-9f5b-60fd3524ade7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.525251 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190cbdd-cfea-41fe-9f5b-60fd3524ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:27.553311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b190cbdd-cfea-41fe-9f5b-60fd3524ade7 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:27.556254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b190cbdd-cfea-41fe-9f5b-60fd3524ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:27.654644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1108/2253] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:27.665623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd7bb-3aa0-4bec-87a7-dfc63f57ef7b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.665833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd7bb-3aa0-4bec-87a7-dfc63f57ef7b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.666110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd7bb-3aa0-4bec-87a7-dfc63f57ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:27.682994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190cbdd-cfea-41fe-9f5b-60fd3524ade7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:27.685319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b190cbdd-cfea-41fe-9f5b-60fd3524ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:27.690897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0acdd7bb-3aa0-4bec-87a7-dfc63f57ef7b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:27.692439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0acdd7bb-3aa0-4bec-87a7-dfc63f57ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:27.704650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1146/2254] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:11:27.705533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190cbdd-cfea-41fe-9f5b-60fd3524ade7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:27.710831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:27.711706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.711918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.712179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] PATH_INFO: `/v3/projects/c055c30c3b0447549f4df91e1f1b2f15` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:27.713321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c055c30c3b0447549f4df91e1f1b2f15)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:27.716079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:27.717837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd7bb-3aa0-4bec-87a7-dfc63f57ef7b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:27.734913 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd7bb-3aa0-4bec-87a7-dfc63f57ef7b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:27.739815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811fbfe-4f4e-4fee-8785-6c72465ab49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:27.740435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811fbfe-4f4e-4fee-8785-6c72465ab49c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.740733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811fbfe-4f4e-4fee-8785-6c72465ab49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.740991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811fbfe-4f4e-4fee-8785-6c72465ab49c admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:27.741686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811fbfe-4f4e-4fee-8785-6c72465ab49c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:27.741990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811fbfe-4f4e-4fee-8785-6c72465ab49c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:27.743647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811fbfe-4f4e-4fee-8785-6c72465ab49c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:27.757208 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1147/2255] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:11:27.758075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811fbfe-4f4e-4fee-8785-6c72465ab49c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:27.760068 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c811fbfe-4f4e-4fee-8785-6c72465ab49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:27.771402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c055c30c3b0447549f4df91e1f1b2f15', 'request_id': 'req-b1688e9b-4923-479f-85c7-e421f149b66d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.774081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811fbfe-4f4e-4fee-8785-6c72465ab49c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:27.777355 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c055c30c3b0447549f4df91e1f1b2f15', 'request_id': 'req-b1688e9b-4923-479f-85c7-e421f149b66d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.786723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c055c30c3b0447549f4df91e1f1b2f15', 'request_id': 'req-b1688e9b-4923-479f-85c7-e421f149b66d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.799267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] The token cache is being invalidate because project c055c30c3b0447549f4df91e1f1b2f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:27.799559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.800227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.801801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1109/2256] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:27 2022] DELETE /identity/v3/projects/c055c30c3b0447549f4df91e1f1b2f15 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:27.802926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:27.804582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:27.808805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:27.827390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:27.839856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:27.839856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.840199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.840431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] PATH_INFO: `/v3/users/33462747b97d4364b7ed9e25ef5a3e1e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:27.841478 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=33462747b97d4364b7ed9e25ef5a3e1e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:27.843416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:27.872537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1688e9b-4923-479f-85c7-e421f149b66d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:27.877773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135552f1-0fd9-4d74-8a88-cb3dd76d48ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:27.878384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135552f1-0fd9-4d74-8a88-cb3dd76d48ea admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.878658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135552f1-0fd9-4d74-8a88-cb3dd76d48ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.878922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135552f1-0fd9-4d74-8a88-cb3dd76d48ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:27.879551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135552f1-0fd9-4d74-8a88-cb3dd76d48ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:27.881909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135552f1-0fd9-4d74-8a88-cb3dd76d48ea admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:27.890943 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33462747b97d4364b7ed9e25ef5a3e1e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.891608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33462747b97d4364b7ed9e25ef5a3e1e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.904686 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33462747b97d4364b7ed9e25ef5a3e1e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.914106 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1110/2257] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:27 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:27.914106 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92298-2e6f-4ed5-ab6d-4b184cf75db0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.914106 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92298-2e6f-4ed5-ab6d-4b184cf75db0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.914106 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92298-2e6f-4ed5-ab6d-4b184cf75db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:27.914460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33462747b97d4364b7ed9e25ef5a3e1e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.914460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33462747b97d4364b7ed9e25ef5a3e1e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:27.931422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1148/2258] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:27 2022] DELETE /identity/v3/users/33462747b97d4364b7ed9e25ef5a3e1e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:27.931422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:27.931422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:27.936230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-84c92298-2e6f-4ed5-ab6d-4b184cf75db0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:27.937429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-84c92298-2e6f-4ed5-ab6d-4b184cf75db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:27.995413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1111/2259] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:27.997263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa90af-e7dc-4ef6-a8aa-c345f8385abb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:27.997263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa90af-e7dc-4ef6-a8aa-c345f8385abb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:27.997400 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f60b0c-1857-42a1-831b-0521532625bf admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:27.997506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa90af-e7dc-4ef6-a8aa-c345f8385abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.002106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8597a0a-74f2-4021-888c-92ea45358412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.002723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8597a0a-74f2-4021-888c-92ea45358412 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.003244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8597a0a-74f2-4021-888c-92ea45358412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.003521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8597a0a-74f2-4021-888c-92ea45358412 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.004155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8597a0a-74f2-4021-888c-92ea45358412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.007921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8597a0a-74f2-4021-888c-92ea45358412 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.017657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f2aa90af-e7dc-4ef6-a8aa-c345f8385abb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:28.018881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f2aa90af-e7dc-4ef6-a8aa-c345f8385abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.029724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1112/2260] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:28.030965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb543f7b-f182-447d-8428-33941128fa21 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.031230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb543f7b-f182-447d-8428-33941128fa21 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.031500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb543f7b-f182-447d-8428-33941128fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.035463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1149/2261] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:27 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:28.036467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8597a0a-74f2-4021-888c-92ea45358412 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.046539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8597a0a-74f2-4021-888c-92ea45358412 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.051261 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cb543f7b-f182-447d-8428-33941128fa21 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:28.051457 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa408843-f8d4-4248-b7e2-5fb80a019381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.052065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa408843-f8d4-4248-b7e2-5fb80a019381 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.052424 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa408843-f8d4-4248-b7e2-5fb80a019381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.052631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cb543f7b-f182-447d-8428-33941128fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.052740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa408843-f8d4-4248-b7e2-5fb80a019381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.053340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa408843-f8d4-4248-b7e2-5fb80a019381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.054934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa408843-f8d4-4248-b7e2-5fb80a019381 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.060802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1113/2262] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:28.064482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb543f7b-f182-447d-8428-33941128fa21 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.064482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cb543f7b-f182-447d-8428-33941128fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.066056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1150/2263] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:28.066878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa408843-f8d4-4248-b7e2-5fb80a019381 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.079107 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa408843-f8d4-4248-b7e2-5fb80a019381 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.084060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f658a-8f40-4e03-90b9-28b97b4ba1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.084703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f658a-8f40-4e03-90b9-28b97b4ba1ff admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.084992 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f658a-8f40-4e03-90b9-28b97b4ba1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.085295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f658a-8f40-4e03-90b9-28b97b4ba1ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.085941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f658a-8f40-4e03-90b9-28b97b4ba1ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:28.086244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f658a-8f40-4e03-90b9-28b97b4ba1ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.087893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f658a-8f40-4e03-90b9-28b97b4ba1ff admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.100104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1151/2264] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:11:28.100900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f658a-8f40-4e03-90b9-28b97b4ba1ff admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.111282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f658a-8f40-4e03-90b9-28b97b4ba1ff admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.116321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc7bd8-a04f-47f4-8601-98516fc4b9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.117063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc7bd8-a04f-47f4-8601-98516fc4b9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.117341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc7bd8-a04f-47f4-8601-98516fc4b9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.117731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc7bd8-a04f-47f4-8601-98516fc4b9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.118391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc7bd8-a04f-47f4-8601-98516fc4b9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.119952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc7bd8-a04f-47f4-8601-98516fc4b9b1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.121732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb543f7b-f182-447d-8428-33941128fa21 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.125563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67139e31-a1b9-4154-82d3-c34a169fd425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.126674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67139e31-a1b9-4154-82d3-c34a169fd425 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.126674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67139e31-a1b9-4154-82d3-c34a169fd425 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.126858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67139e31-a1b9-4154-82d3-c34a169fd425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.137758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1152/2265] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:28.139235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc7bd8-a04f-47f4-8601-98516fc4b9b1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.139793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67139e31-a1b9-4154-82d3-c34a169fd425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.141636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67139e31-a1b9-4154-82d3-c34a169fd425 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.152416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc7bd8-a04f-47f4-8601-98516fc4b9b1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.157885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575af13-1261-463f-9471-6658a47547bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.160793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575af13-1261-463f-9471-6658a47547bf admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.161102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575af13-1261-463f-9471-6658a47547bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.161378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575af13-1261-463f-9471-6658a47547bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.162174 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575af13-1261-463f-9471-6658a47547bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.164289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575af13-1261-463f-9471-6658a47547bf admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.174605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:28.175593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1114/2266] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:28.178775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67139e31-a1b9-4154-82d3-c34a169fd425 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.193053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67139e31-a1b9-4154-82d3-c34a169fd425 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.199587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d22c9d-9969-4bc4-aa91-e5df3ddd2b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.200317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22c9d-9969-4bc4-aa91-e5df3ddd2b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.200781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22c9d-9969-4bc4-aa91-e5df3ddd2b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.201058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22c9d-9969-4bc4-aa91-e5df3ddd2b21 admin admin] PATH_INFO: `/v3/projects/da5bcae31a014357b31835a13d9cca6a/users/b77d84a1f52d495b8562c7212d31d9c8/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.220926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d22c9d-9969-4bc4-aa91-e5df3ddd2b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5bcae31a014357b31835a13d9cca6a, user_id=b77d84a1f52d495b8562c7212d31d9c8, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.224466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d22c9d-9969-4bc4-aa91-e5df3ddd2b21 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.225734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1153/2267] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:28 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:28.230717 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575af13-1261-463f-9471-6658a47547bf admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.241888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1115/2268] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:28 2022] PUT /identity/v3/projects/da5bcae31a014357b31835a13d9cca6a/users/b77d84a1f52d495b8562c7212d31d9c8/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:28.259116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81d54-fc92-4183-940f-712a67951859 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.260192 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81d54-fc92-4183-940f-712a67951859 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.260772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81d54-fc92-4183-940f-712a67951859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.291197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:28.301829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-81a81d54-fc92-4183-940f-712a67951859 None None] MFA Rules not processed for user `b77d84a1f52d495b8562c7212d31d9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:28.303851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-81a81d54-fc92-4183-940f-712a67951859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.317366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575af13-1261-463f-9471-6658a47547bf admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.389439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1116/2269] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:11:28.404055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a81d54-fc92-4183-940f-712a67951859 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.409166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-81a81d54-fc92-4183-940f-712a67951859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.528106 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a81d54-fc92-4183-940f-712a67951859 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.533129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cdbbc-535a-4068-b9ec-e2e064e8e931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.533898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cdbbc-535a-4068-b9ec-e2e064e8e931 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.534249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cdbbc-535a-4068-b9ec-e2e064e8e931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.534598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cdbbc-535a-4068-b9ec-e2e064e8e931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.545644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cdbbc-535a-4068-b9ec-e2e064e8e931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.548313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cdbbc-535a-4068-b9ec-e2e064e8e931 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.558847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1117/2270] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:28.567365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad97e9-51ae-4931-bbf6-3d000397b1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.568088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad97e9-51ae-4931-bbf6-3d000397b1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.568374 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad97e9-51ae-4931-bbf6-3d000397b1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.568973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad97e9-51ae-4931-bbf6-3d000397b1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.569312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad97e9-51ae-4931-bbf6-3d000397b1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.571237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad97e9-51ae-4931-bbf6-3d000397b1d2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.587202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cdbbc-535a-4068-b9ec-e2e064e8e931 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.603412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1154/2271] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:28 2022] POST /identity/v3/users => generated 291 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:28.605311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad97e9-51ae-4931-bbf6-3d000397b1d2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.613121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cdbbc-535a-4068-b9ec-e2e064e8e931 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.621327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.622417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.622752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.623590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] PATH_INFO: `/v3/users/b77d84a1f52d495b8562c7212d31d9c8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.624209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad97e9-51ae-4931-bbf6-3d000397b1d2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.625571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b77d84a1f52d495b8562c7212d31d9c8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.627960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.644280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eeccbd-793c-4822-9a95-9afd0c640017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.645513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeccbd-793c-4822-9a95-9afd0c640017 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.646020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeccbd-793c-4822-9a95-9afd0c640017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.646511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeccbd-793c-4822-9a95-9afd0c640017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.647340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eeccbd-793c-4822-9a95-9afd0c640017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.649332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eeccbd-793c-4822-9a95-9afd0c640017 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.668296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1155/2272] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:28.668296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eeccbd-793c-4822-9a95-9afd0c640017 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.670244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e6eeccbd-793c-4822-9a95-9afd0c640017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.685708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eeccbd-793c-4822-9a95-9afd0c640017 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.690525 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.691078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.691361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.691635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] PATH_INFO: `/v3/projects/86b6f4f833c04682bb4a6f812d1b01ec` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.692758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b6f4f833c04682bb4a6f812d1b01ec)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.694802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.695025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b77d84a1f52d495b8562c7212d31d9c8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.707614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b77d84a1f52d495b8562c7212d31d9c8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.708363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b77d84a1f52d495b8562c7212d31d9c8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.719592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b77d84a1f52d495b8562c7212d31d9c8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.719592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b77d84a1f52d495b8562c7212d31d9c8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.739582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1118/2273] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:28 2022] DELETE /identity/v3/users/b77d84a1f52d495b8562c7212d31d9c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:11:28.740488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.742120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.755999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b6f4f833c04682bb4a6f812d1b01ec', 'request_id': 'req-2e22e684-1c06-46e6-bf67-7e8640468c12'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.761797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b6f4f833c04682bb4a6f812d1b01ec', 'request_id': 'req-2e22e684-1c06-46e6-bf67-7e8640468c12'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.763089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:28.772651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b6f4f833c04682bb4a6f812d1b01ec', 'request_id': 'req-2e22e684-1c06-46e6-bf67-7e8640468c12'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.776241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:28.796237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] The token cache is being invalidate because project 86b6f4f833c04682bb4a6f812d1b01ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:28.796689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.797515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2e22e684-1c06-46e6-bf67-7e8640468c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.799248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1156/2274] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:28 2022] DELETE /identity/v3/projects/86b6f4f833c04682bb4a6f812d1b01ec => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:28.800454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed44c7f-4bec-4455-8977-17270d9edd0e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.800733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed44c7f-4bec-4455-8977-17270d9edd0e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.801057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed44c7f-4bec-4455-8977-17270d9edd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.820503 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fed44c7f-4bec-4455-8977-17270d9edd0e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:28.821749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fed44c7f-4bec-4455-8977-17270d9edd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.824739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4977f-a307-447b-ba9e-54a2c3699e78 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.833278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49b2b8-fbcc-4de1-ba5b-92fca02c2b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.833482 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1157/2275] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:28.833597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49b2b8-fbcc-4de1-ba5b-92fca02c2b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.833597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49b2b8-fbcc-4de1-ba5b-92fca02c2b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.833736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed44c7f-4bec-4455-8977-17270d9edd0e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.833808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49b2b8-fbcc-4de1-ba5b-92fca02c2b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.833808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49b2b8-fbcc-4de1-ba5b-92fca02c2b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.833808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49b2b8-fbcc-4de1-ba5b-92fca02c2b42 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.840320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fed44c7f-4bec-4455-8977-17270d9edd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.848402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1119/2276] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:28.848402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49b2b8-fbcc-4de1-ba5b-92fca02c2b42 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.848402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0a49b2b8-fbcc-4de1-ba5b-92fca02c2b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.852259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed44c7f-4bec-4455-8977-17270d9edd0e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.857049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.857685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.857966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.858251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] PATH_INFO: `/v3/users/680ef0be02ff48fbbf6e38bc65dc1520` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.859365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=680ef0be02ff48fbbf6e38bc65dc1520)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.861338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.910188 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49b2b8-fbcc-4de1-ba5b-92fca02c2b42 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.914374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87279cd3-54a6-43e4-81bf-4def828cedea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:28.914987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87279cd3-54a6-43e4-81bf-4def828cedea service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:28.915267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87279cd3-54a6-43e4-81bf-4def828cedea service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:28.915533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87279cd3-54a6-43e4-81bf-4def828cedea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:28.917382 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680ef0be02ff48fbbf6e38bc65dc1520'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.918117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680ef0be02ff48fbbf6e38bc65dc1520'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.929353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87279cd3-54a6-43e4-81bf-4def828cedea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:28.931041 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87279cd3-54a6-43e4-81bf-4def828cedea service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:28.932735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680ef0be02ff48fbbf6e38bc65dc1520'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.942088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680ef0be02ff48fbbf6e38bc65dc1520'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.942440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1120/2277] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:28.943138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-799f8787-89b2-4b6f-a0dc-a957531d46ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680ef0be02ff48fbbf6e38bc65dc1520'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:28.950059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87279cd3-54a6-43e4-81bf-4def828cedea service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:28.953421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-87279cd3-54a6-43e4-81bf-4def828cedea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:28.978389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87279cd3-54a6-43e4-81bf-4def828cedea service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:28.980079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1158/2278] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:28 2022] DELETE /identity/v3/users/680ef0be02ff48fbbf6e38bc65dc1520 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:29.105528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7b6a2-540a-4eec-b7df-a8bc0773ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:29.106446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7b6a2-540a-4eec-b7df-a8bc0773ca5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:29.107230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7b6a2-540a-4eec-b7df-a8bc0773ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:29.107651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7b6a2-540a-4eec-b7df-a8bc0773ca5d admin admin] PATH_INFO: `/v3/projects/59b969778e2e4ac4a85f170e33ff7bb0/users/089996c73f3c49bf902e6ca639242e65/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:29.138763 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7b6a2-540a-4eec-b7df-a8bc0773ca5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b969778e2e4ac4a85f170e33ff7bb0, user_id=089996c73f3c49bf902e6ca639242e65, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:29.142600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7b6a2-540a-4eec-b7df-a8bc0773ca5d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:29.177067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1121/2279] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:28 2022] PUT /identity/v3/projects/59b969778e2e4ac4a85f170e33ff7bb0/users/089996c73f3c49bf902e6ca639242e65/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:29.182221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6316-2c8f-4d28-b442-7fdcd939f70f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:29.182621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6316-2c8f-4d28-b442-7fdcd939f70f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:29.183018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6316-2c8f-4d28-b442-7fdcd939f70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:29.218907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-583c6316-2c8f-4d28-b442-7fdcd939f70f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:29.220202 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-583c6316-2c8f-4d28-b442-7fdcd939f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:29.319647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1159/2280] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:29.330667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7b6a2-540a-4eec-b7df-a8bc0773ca5d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:29.332572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ecb7b6a2-540a-4eec-b7df-a8bc0773ca5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:29.430051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:29.451710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7b6a2-540a-4eec-b7df-a8bc0773ca5d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:29.456229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ce208-9243-4590-b7b1-9a7f80930903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:29.456916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce208-9243-4590-b7b1-9a7f80930903 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:29.457227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce208-9243-4590-b7b1-9a7f80930903 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:29.457619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ce208-9243-4590-b7b1-9a7f80930903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:29.500608 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ce208-9243-4590-b7b1-9a7f80930903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:29.503232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ce208-9243-4590-b7b1-9a7f80930903 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:29.517288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1122/2281] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:29.593115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6316-2c8f-4d28-b442-7fdcd939f70f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:29.594624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-583c6316-2c8f-4d28-b442-7fdcd939f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:29.612072 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6316-2c8f-4d28-b442-7fdcd939f70f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:29.620286 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:29.621010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:29.621343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:29.621673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] PATH_INFO: `/v3/projects/da5bcae31a014357b31835a13d9cca6a` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:29.623074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5bcae31a014357b31835a13d9cca6a)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:29.625083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:29.709273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ce208-9243-4590-b7b1-9a7f80930903 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:29.712862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d25ce208-9243-4590-b7b1-9a7f80930903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:29.734092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5bcae31a014357b31835a13d9cca6a', 'request_id': 'req-7abd8c18-493a-40e3-b155-008352c7fd46'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:29.740575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:29.742386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5bcae31a014357b31835a13d9cca6a', 'request_id': 'req-7abd8c18-493a-40e3-b155-008352c7fd46'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:29.756176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5bcae31a014357b31835a13d9cca6a', 'request_id': 'req-7abd8c18-493a-40e3-b155-008352c7fd46'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:29.781515 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ce208-9243-4590-b7b1-9a7f80930903 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:29.784935 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] The token cache is being invalidate because project da5bcae31a014357b31835a13d9cca6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:29.785824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:29.787055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-7abd8c18-493a-40e3-b155-008352c7fd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:29.789056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1160/2282] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:29 2022] DELETE /identity/v3/projects/da5bcae31a014357b31835a13d9cca6a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:29.794273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b063e7-f7ea-454d-ac72-b0f490b52e0f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:29.794718 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b063e7-f7ea-454d-ac72-b0f490b52e0f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:29.795168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b063e7-f7ea-454d-ac72-b0f490b52e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:29.819772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-55b063e7-f7ea-454d-ac72-b0f490b52e0f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:29.821465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-55b063e7-f7ea-454d-ac72-b0f490b52e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:29.879231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:29.880964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:29.881530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:29.881793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] PATH_INFO: `/v3/projects/1158215302bc4cd38ea34f772f87ed1f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:29.883304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1158215302bc4cd38ea34f772f87ed1f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:29.885444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:29.926901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1161/2283] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:11:29.935713 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013e897-3cd4-436d-b852-325da8058e00 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:29.936003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013e897-3cd4-436d-b852-325da8058e00 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:29.936309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013e897-3cd4-436d-b852-325da8058e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:29.948501 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1158215302bc4cd38ea34f772f87ed1f', 'request_id': 'req-2535e538-6c08-46f5-8e9f-c18a93ea412b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:29.956224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1158215302bc4cd38ea34f772f87ed1f', 'request_id': 'req-2535e538-6c08-46f5-8e9f-c18a93ea412b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:29.963768 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2013e897-3cd4-436d-b852-325da8058e00 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:29.965113 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2013e897-3cd4-436d-b852-325da8058e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:29.965790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1158215302bc4cd38ea34f772f87ed1f', 'request_id': 'req-2535e538-6c08-46f5-8e9f-c18a93ea412b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:29.981816 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] The token cache is being invalidate because project 1158215302bc4cd38ea34f772f87ed1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:29.982134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:29.982888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2535e538-6c08-46f5-8e9f-c18a93ea412b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:29.984694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1123/2284] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:29 2022] DELETE /identity/v3/projects/1158215302bc4cd38ea34f772f87ed1f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:29.990133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8642af-51f8-4654-aa78-7a2ede9e7a60 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:29.990656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8642af-51f8-4654-aa78-7a2ede9e7a60 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:29.991108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8642af-51f8-4654-aa78-7a2ede9e7a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.020076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5f8642af-51f8-4654-aa78-7a2ede9e7a60 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:30.021704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5f8642af-51f8-4654-aa78-7a2ede9e7a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:30.045333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1162/2285] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:30.055871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013e897-3cd4-436d-b852-325da8058e00 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.093014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013e897-3cd4-436d-b852-325da8058e00 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.102423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3b5b2-43b2-4853-88f7-9538218a0b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.104519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3b5b2-43b2-4853-88f7-9538218a0b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.105350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3b5b2-43b2-4853-88f7-9538218a0b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.105878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3b5b2-43b2-4853-88f7-9538218a0b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.106853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3b5b2-43b2-4853-88f7-9538218a0b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:30.107393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3b5b2-43b2-4853-88f7-9538218a0b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.109681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3b5b2-43b2-4853-88f7-9538218a0b9e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.124720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1124/2286] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:11:30.134916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee49f-3c83-4060-ab02-6a48c1e243d0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.135190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee49f-3c83-4060-ab02-6a48c1e243d0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.135461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee49f-3c83-4060-ab02-6a48c1e243d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.154272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1163/2287] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:11:30.161093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3b5b2-43b2-4853-88f7-9538218a0b9e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.177060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3b5b2-43b2-4853-88f7-9538218a0b9e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.182392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f7eee49f-3c83-4060-ab02-6a48c1e243d0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:30.183838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f7eee49f-3c83-4060-ab02-6a48c1e243d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:30.184418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fead49d-2413-4721-92f3-c97ac4af4ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.185081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead49d-2413-4721-92f3-c97ac4af4ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.185377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead49d-2413-4721-92f3-c97ac4af4ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.187037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead49d-2413-4721-92f3-c97ac4af4ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.187037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fead49d-2413-4721-92f3-c97ac4af4ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.189461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fead49d-2413-4721-92f3-c97ac4af4ddb admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.198177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1125/2288] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:30.203339 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee49f-3c83-4060-ab02-6a48c1e243d0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.216003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:30.221766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee49f-3c83-4060-ab02-6a48c1e243d0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.230038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abe644-545f-47c6-8ae3-bf364cb02f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.231013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abe644-545f-47c6-8ae3-bf364cb02f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.231891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abe644-545f-47c6-8ae3-bf364cb02f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.232247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abe644-545f-47c6-8ae3-bf364cb02f3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.233587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abe644-545f-47c6-8ae3-bf364cb02f3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:30.233978 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abe644-545f-47c6-8ae3-bf364cb02f3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.234771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1164/2289] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:30 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:30.238752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abe644-545f-47c6-8ae3-bf364cb02f3f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.239622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fead49d-2413-4721-92f3-c97ac4af4ddb admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.257532 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1126/2290] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:11:30.262388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abe644-545f-47c6-8ae3-bf364cb02f3f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.273478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abe644-545f-47c6-8ae3-bf364cb02f3f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.303290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:30.325184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fead49d-2413-4721-92f3-c97ac4af4ddb admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.332542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3edcc-cee8-4c38-9493-8e2fb918aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.333553 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3edcc-cee8-4c38-9493-8e2fb918aaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.334139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3edcc-cee8-4c38-9493-8e2fb918aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.334660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3edcc-cee8-4c38-9493-8e2fb918aaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.335445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3edcc-cee8-4c38-9493-8e2fb918aaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.337671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3edcc-cee8-4c38-9493-8e2fb918aaa9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.367214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2a07b-25a7-4575-97e1-8c8c46b1c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.370665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1165/2291] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:30 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:30.372079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2a07b-25a7-4575-97e1-8c8c46b1c9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.372206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3edcc-cee8-4c38-9493-8e2fb918aaa9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.372629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2a07b-25a7-4575-97e1-8c8c46b1c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.372970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2a07b-25a7-4575-97e1-8c8c46b1c9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.374015 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2a07b-25a7-4575-97e1-8c8c46b1c9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.376683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2a07b-25a7-4575-97e1-8c8c46b1c9f4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.387172 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3edcc-cee8-4c38-9493-8e2fb918aaa9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.392629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92e77-c7bd-4013-ab88-293b86289ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.393289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92e77-c7bd-4013-ab88-293b86289ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.393634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92e77-c7bd-4013-ab88-293b86289ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.394095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd92e77-c7bd-4013-ab88-293b86289ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.394821 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd92e77-c7bd-4013-ab88-293b86289ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.397312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd92e77-c7bd-4013-ab88-293b86289ac0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.417710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1166/2292] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:30.421896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92e77-c7bd-4013-ab88-293b86289ac0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.435209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd92e77-c7bd-4013-ab88-293b86289ac0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.435822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1127/2293] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:30 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:11:30.436881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2a07b-25a7-4575-97e1-8c8c46b1c9f4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.553226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e069f06-ca8b-429b-b9c0-86d0a79b1ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.554021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069f06-ca8b-429b-b9c0-86d0a79b1ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.554313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069f06-ca8b-429b-b9c0-86d0a79b1ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.554567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069f06-ca8b-429b-b9c0-86d0a79b1ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.555215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e069f06-ca8b-429b-b9c0-86d0a79b1ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.556785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2a07b-25a7-4575-97e1-8c8c46b1c9f4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.558838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e069f06-ca8b-429b-b9c0-86d0a79b1ce6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.562604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e7335-2cb6-4368-9393-db06259ccf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.563383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e7335-2cb6-4368-9393-db06259ccf83 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.563670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e7335-2cb6-4368-9393-db06259ccf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.563948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e7335-2cb6-4368-9393-db06259ccf83 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.564734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e7335-2cb6-4368-9393-db06259ccf83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.567098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e7335-2cb6-4368-9393-db06259ccf83 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.587137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1167/2294] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:11:30.588674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f762a3e-157f-411f-a803-424b4abd265e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.589006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f762a3e-157f-411f-a803-424b4abd265e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.589310 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f762a3e-157f-411f-a803-424b4abd265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.617577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1128/2295] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:30 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:30.623844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e7335-2cb6-4368-9393-db06259ccf83 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.625557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3f762a3e-157f-411f-a803-424b4abd265e None None] MFA Rules not processed for user `089996c73f3c49bf902e6ca639242e65`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:30.626811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3f762a3e-157f-411f-a803-424b4abd265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:30.647789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e7335-2cb6-4368-9393-db06259ccf83 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.659757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd87e5-9d68-48c1-bdcd-860e47b896ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.660500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd87e5-9d68-48c1-bdcd-860e47b896ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.660784 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd87e5-9d68-48c1-bdcd-860e47b896ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.661200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd87e5-9d68-48c1-bdcd-860e47b896ba admin admin] PATH_INFO: `/v3/projects/119fb3b5ff1a4ccda4824dbf26dfb7e3/users/c6e85017753e4a87a560cb384bea179b/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.703974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd87e5-9d68-48c1-bdcd-860e47b896ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=119fb3b5ff1a4ccda4824dbf26dfb7e3, user_id=c6e85017753e4a87a560cb384bea179b, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.707557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd87e5-9d68-48c1-bdcd-860e47b896ba admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.737142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1129/2296] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:30 2022] PUT /identity/v3/projects/119fb3b5ff1a4ccda4824dbf26dfb7e3/users/c6e85017753e4a87a560cb384bea179b/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:30.738324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd87e5-9d68-48c1-bdcd-860e47b896ba admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.746281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1168/2297] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:30.748089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96744f92-eaac-4052-8041-fcbacae88e67 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.748786 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96744f92-eaac-4052-8041-fcbacae88e67 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.753399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96744f92-eaac-4052-8041-fcbacae88e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.777990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-96744f92-eaac-4052-8041-fcbacae88e67 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:30.779334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-96744f92-eaac-4052-8041-fcbacae88e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:30.802105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:30.833140 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd87e5-9d68-48c1-bdcd-860e47b896ba admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.835021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:30.848814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1169/2298] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:30.852066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96744f92-eaac-4052-8041-fcbacae88e67 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.852066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-96744f92-eaac-4052-8041-fcbacae88e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:30.855059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc70c2a-cc4d-41a2-90df-6c360d85941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.855701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70c2a-cc4d-41a2-90df-6c360d85941f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.855979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70c2a-cc4d-41a2-90df-6c360d85941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.856258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc70c2a-cc4d-41a2-90df-6c360d85941f admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.856916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc70c2a-cc4d-41a2-90df-6c360d85941f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.858634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc70c2a-cc4d-41a2-90df-6c360d85941f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.873191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1130/2299] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:30.873191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc70c2a-cc4d-41a2-90df-6c360d85941f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.874945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7fc70c2a-cc4d-41a2-90df-6c360d85941f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:30.913166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96744f92-eaac-4052-8041-fcbacae88e67 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.917176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5b27-40ac-40f3-90f9-43d6431c1518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.917799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5b27-40ac-40f3-90f9-43d6431c1518 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.918076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5b27-40ac-40f3-90f9-43d6431c1518 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.918347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5b27-40ac-40f3-90f9-43d6431c1518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.942473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc70c2a-cc4d-41a2-90df-6c360d85941f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.946309 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721c25-9509-47ca-ace9-57ea209cc1be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.946923 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721c25-9509-47ca-ace9-57ea209cc1be service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.947205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721c25-9509-47ca-ace9-57ea209cc1be service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.947475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721c25-9509-47ca-ace9-57ea209cc1be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.957338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d721c25-9509-47ca-ace9-57ea209cc1be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.959180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d721c25-9509-47ca-ace9-57ea209cc1be service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.970047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1131/2300] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:30.976642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721c25-9509-47ca-ace9-57ea209cc1be service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:30.990634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721c25-9509-47ca-ace9-57ea209cc1be service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:30.991144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf5b27-40ac-40f3-90f9-43d6431c1518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:30.992764 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf5b27-40ac-40f3-90f9-43d6431c1518 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:30.995844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf671e5-8879-429b-8ac8-1db40585633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:30.996497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf671e5-8879-429b-8ac8-1db40585633a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:30.996967 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf671e5-8879-429b-8ac8-1db40585633a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:30.997274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf671e5-8879-429b-8ac8-1db40585633a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:30.998462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf671e5-8879-429b-8ac8-1db40585633a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:31.000793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf671e5-8879-429b-8ac8-1db40585633a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:31.003208 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1170/2301] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:31.012320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1132/2302] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:31.016909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5b27-40ac-40f3-90f9-43d6431c1518 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:31.030870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5b27-40ac-40f3-90f9-43d6431c1518 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:31.037842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d3519-7f01-4b57-b27a-8d8f52fda29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:31.038521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d3519-7f01-4b57-b27a-8d8f52fda29f admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:31.038810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d3519-7f01-4b57-b27a-8d8f52fda29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:31.039081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d3519-7f01-4b57-b27a-8d8f52fda29f admin admin] PATH_INFO: `/v3/projects/cbf69d0ed7464a908e5016ef5fc85e77/users/696d5661ec3a4b1d973098c14d034972/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:31.061995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d3519-7f01-4b57-b27a-8d8f52fda29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf69d0ed7464a908e5016ef5fc85e77, user_id=696d5661ec3a4b1d973098c14d034972, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:31.066472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d3519-7f01-4b57-b27a-8d8f52fda29f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:31.086182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1171/2303] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:31 2022] PUT /identity/v3/projects/cbf69d0ed7464a908e5016ef5fc85e77/users/696d5661ec3a4b1d973098c14d034972/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:31.091640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b77b2-43f4-44e7-9e45-b7bdacbc9156 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:31.091932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b77b2-43f4-44e7-9e45-b7bdacbc9156 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:31.092237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b77b2-43f4-44e7-9e45-b7bdacbc9156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:31.113497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-165b77b2-43f4-44e7-9e45-b7bdacbc9156 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:31.115289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-165b77b2-43f4-44e7-9e45-b7bdacbc9156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:31.249088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1133/2304] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:31.260274 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d3519-7f01-4b57-b27a-8d8f52fda29f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:31.262745 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e56d3519-7f01-4b57-b27a-8d8f52fda29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:31.351274 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d3519-7f01-4b57-b27a-8d8f52fda29f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:31.364656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affa8cf-f2f0-433d-94e1-af3d0f3d98a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:31.365393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa8cf-f2f0-433d-94e1-af3d0f3d98a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:31.365670 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa8cf-f2f0-433d-94e1-af3d0f3d98a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:31.366029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa8cf-f2f0-433d-94e1-af3d0f3d98a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:31.393518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affa8cf-f2f0-433d-94e1-af3d0f3d98a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:31.396966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affa8cf-f2f0-433d-94e1-af3d0f3d98a6 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:31.423073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1172/2305] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:32.673901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9317f-f430-4167-b02b-85b6f6920a8c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:32.674480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9317f-f430-4167-b02b-85b6f6920a8c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:32.675542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9317f-f430-4167-b02b-85b6f6920a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:32.710007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-77c9317f-f430-4167-b02b-85b6f6920a8c None None] MFA Rules not processed for user `089996c73f3c49bf902e6ca639242e65`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:32.710007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-77c9317f-f430-4167-b02b-85b6f6920a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:32.800200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1134/2306] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:32.913584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea870a-b7e7-484e-88da-4b976aaccafa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:32.914131 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea870a-b7e7-484e-88da-4b976aaccafa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:32.914324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea870a-b7e7-484e-88da-4b976aaccafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:32.950703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-39ea870a-b7e7-484e-88da-4b976aaccafa None None] MFA Rules not processed for user `696d5661ec3a4b1d973098c14d034972`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:32.952117 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-39ea870a-b7e7-484e-88da-4b976aaccafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:32.973443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:33.036001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1173/2307] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:33.037488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9317f-f430-4167-b02b-85b6f6920a8c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:33.052676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9317f-f430-4167-b02b-85b6f6920a8c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:33.058526 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1953ea-3789-4c6e-939b-be78e2accfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:33.060199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1953ea-3789-4c6e-939b-be78e2accfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:33.060561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1953ea-3789-4c6e-939b-be78e2accfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:33.062503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1953ea-3789-4c6e-939b-be78e2accfb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:33.062503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1953ea-3789-4c6e-939b-be78e2accfb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:33.065805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1953ea-3789-4c6e-939b-be78e2accfb8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:33.084449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:33.098824 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1135/2308] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:33 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:33.102924 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea870a-b7e7-484e-88da-4b976aaccafa None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:33.115488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea870a-b7e7-484e-88da-4b976aaccafa None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:33.235363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bc16c-6ca7-40f8-9e3e-a19c2d14de6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:33.236051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bc16c-6ca7-40f8-9e3e-a19c2d14de6d admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:33.236335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bc16c-6ca7-40f8-9e3e-a19c2d14de6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:33.236606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bc16c-6ca7-40f8-9e3e-a19c2d14de6d admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:33.237450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bc16c-6ca7-40f8-9e3e-a19c2d14de6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:33.239415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93bc16c-6ca7-40f8-9e3e-a19c2d14de6d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:33.274499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1174/2309] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:33 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:33.278321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1953ea-3789-4c6e-939b-be78e2accfb8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:33.289419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1953ea-3789-4c6e-939b-be78e2accfb8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:33.294645 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c94301-a9cd-4c77-b002-044b234f7171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:33.295325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c94301-a9cd-4c77-b002-044b234f7171 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:33.295673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c94301-a9cd-4c77-b002-044b234f7171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:33.296011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c94301-a9cd-4c77-b002-044b234f7171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:33.296758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c94301-a9cd-4c77-b002-044b234f7171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:33.298524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c94301-a9cd-4c77-b002-044b234f7171 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:33.309282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1136/2310] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:33.313396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bc16c-6ca7-40f8-9e3e-a19c2d14de6d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:33.323723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bc16c-6ca7-40f8-9e3e-a19c2d14de6d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:33.329671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e46b7-e7bd-4c37-b909-fe274c9d9d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:33.330432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e46b7-e7bd-4c37-b909-fe274c9d9d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:33.330783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e46b7-e7bd-4c37-b909-fe274c9d9d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:33.331124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e46b7-e7bd-4c37-b909-fe274c9d9d19 admin admin] PATH_INFO: `/v3/projects/1d0892348abe4679a72765c4be58ba88/users/8d14814cbef64b4da28597fb147a8cd1/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:33.347328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e46b7-e7bd-4c37-b909-fe274c9d9d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d0892348abe4679a72765c4be58ba88, user_id=8d14814cbef64b4da28597fb147a8cd1, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:33.350204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e46b7-e7bd-4c37-b909-fe274c9d9d19 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:33.375040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1175/2311] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:33 2022] PUT /identity/v3/projects/1d0892348abe4679a72765c4be58ba88/users/8d14814cbef64b4da28597fb147a8cd1/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:33.379147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c94301-a9cd-4c77-b002-044b234f7171 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:33.390958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c94301-a9cd-4c77-b002-044b234f7171 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:33.460742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6b823-f8b0-48e3-8515-d4fe5d027514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:33.461564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6b823-f8b0-48e3-8515-d4fe5d027514 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:33.461916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6b823-f8b0-48e3-8515-d4fe5d027514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:33.462263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6b823-f8b0-48e3-8515-d4fe5d027514 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:33.462992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6b823-f8b0-48e3-8515-d4fe5d027514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:33.464702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6b823-f8b0-48e3-8515-d4fe5d027514 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:33.479683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1137/2312] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:33.481468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e46b7-e7bd-4c37-b909-fe274c9d9d19 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:33.497560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e46b7-e7bd-4c37-b909-fe274c9d9d19 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:33.504793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75544d2-8b74-4d56-b7a9-da670f916335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:33.505005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75544d2-8b74-4d56-b7a9-da670f916335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:33.505597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75544d2-8b74-4d56-b7a9-da670f916335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:33.506194 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75544d2-8b74-4d56-b7a9-da670f916335 admin admin] PATH_INFO: `/v3/projects/1d0892348abe4679a72765c4be58ba88/users/8d14814cbef64b4da28597fb147a8cd1/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:33.509382 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75544d2-8b74-4d56-b7a9-da670f916335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d0892348abe4679a72765c4be58ba88, user_id=8d14814cbef64b4da28597fb147a8cd1, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:33.512119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75544d2-8b74-4d56-b7a9-da670f916335 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:33.529217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1176/2313] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:33 2022] PUT /identity/v3/projects/1d0892348abe4679a72765c4be58ba88/users/8d14814cbef64b4da28597fb147a8cd1/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:11:34.434387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a610a0-67d9-4b97-a505-71e67e4d4e6a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:34.435476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a610a0-67d9-4b97-a505-71e67e4d4e6a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:34.435902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a610a0-67d9-4b97-a505-71e67e4d4e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:34.493705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c2a610a0-67d9-4b97-a505-71e67e4d4e6a None None] MFA Rules not processed for user `8d14814cbef64b4da28597fb147a8cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:34.495412 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c2a610a0-67d9-4b97-a505-71e67e4d4e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:34.614920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1138/2314] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:34.628277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc09f1-a0c4-42b1-bb3c-b2f3ba60f23b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:34.628775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc09f1-a0c4-42b1-bb3c-b2f3ba60f23b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:34.628855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc09f1-a0c4-42b1-bb3c-b2f3ba60f23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:34.651489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-85bc09f1-a0c4-42b1-bb3c-b2f3ba60f23b None None] MFA Rules not processed for user `696d5661ec3a4b1d973098c14d034972`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:34.653383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-85bc09f1-a0c4-42b1-bb3c-b2f3ba60f23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:34.740211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1177/2315] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:34.946757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a610a0-67d9-4b97-a505-71e67e4d4e6a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:34.948484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c2a610a0-67d9-4b97-a505-71e67e4d4e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:35.012796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc09f1-a0c4-42b1-bb3c-b2f3ba60f23b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:35.014727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-85bc09f1-a0c4-42b1-bb3c-b2f3ba60f23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:35.053281 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:35.059112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:35.063945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a610a0-67d9-4b97-a505-71e67e4d4e6a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:35.074020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459dbe3-a45b-4d3d-97c2-5df98ef8f734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:35.074810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459dbe3-a45b-4d3d-97c2-5df98ef8f734 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:35.075692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459dbe3-a45b-4d3d-97c2-5df98ef8f734 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:35.076177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459dbe3-a45b-4d3d-97c2-5df98ef8f734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:35.092044 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459dbe3-a45b-4d3d-97c2-5df98ef8f734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:35.097219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459dbe3-a45b-4d3d-97c2-5df98ef8f734 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:35.123673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1139/2316] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:35.155232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc09f1-a0c4-42b1-bb3c-b2f3ba60f23b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:35.161746 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:35.162569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:35.162956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:35.163128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] PATH_INFO: `/v3/users/d5b0a01123b643d899a855e1ff6cded6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:35.164317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b0a01123b643d899a855e1ff6cded6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:35.166333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:35.287091 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b0a01123b643d899a855e1ff6cded6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:35.288292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b0a01123b643d899a855e1ff6cded6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:35.306803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b0a01123b643d899a855e1ff6cded6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:35.319339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b0a01123b643d899a855e1ff6cded6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:35.320926 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b0a01123b643d899a855e1ff6cded6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:35.350475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1178/2317] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:11:35 2022] DELETE /identity/v3/users/d5b0a01123b643d899a855e1ff6cded6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:11:35.352203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c67e-742b-408b-a72d-a4b01a59e2d3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:35.352486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c67e-742b-408b-a72d-a4b01a59e2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:35.352756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c67e-742b-408b-a72d-a4b01a59e2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:35.373590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ef36c67e-742b-408b-a72d-a4b01a59e2d3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:35.374562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef36c67e-742b-408b-a72d-a4b01a59e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:35.459980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1140/2318] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:35.469880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:35.471640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:35.577931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f8310-2ffb-4fd7-9ec7-82736c29b49e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:35.584816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ad653-2fd2-4150-b773-4dab4e40701a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:35.584964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ad653-2fd2-4150-b773-4dab4e40701a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:35.585288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ad653-2fd2-4150-b773-4dab4e40701a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:35.585563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ad653-2fd2-4150-b773-4dab4e40701a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:35.601169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ad653-2fd2-4150-b773-4dab4e40701a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:35.602647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ad653-2fd2-4150-b773-4dab4e40701a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:35.618203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1179/2319] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:35.954308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36c67e-742b-408b-a72d-a4b01a59e2d3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:35.955900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef36c67e-742b-408b-a72d-a4b01a59e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:35.990126 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36c67e-742b-408b-a72d-a4b01a59e2d3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:36.007854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:36.008901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:36.009350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:36.009881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] PATH_INFO: `/v3/projects/03e42efa532b45fb93ae5a30084762fd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:36.012023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e42efa532b45fb93ae5a30084762fd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:36.016719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:36.143839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e42efa532b45fb93ae5a30084762fd', 'request_id': 'req-2179cfe9-17c4-48e1-a738-c0c6c2218015'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:36.160109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e42efa532b45fb93ae5a30084762fd', 'request_id': 'req-2179cfe9-17c4-48e1-a738-c0c6c2218015'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:36.170956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e42efa532b45fb93ae5a30084762fd', 'request_id': 'req-2179cfe9-17c4-48e1-a738-c0c6c2218015'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:36.190476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] The token cache is being invalidate because project 03e42efa532b45fb93ae5a30084762fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:11:36.191114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:36.192917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2179cfe9-17c4-48e1-a738-c0c6c2218015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:11:36.200548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fae32-a8ef-4618-b27e-083c7e3001b9 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:36.201296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1141/2320] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:11:35 2022] DELETE /identity/v3/projects/03e42efa532b45fb93ae5a30084762fd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:36.201720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fae32-a8ef-4618-b27e-083c7e3001b9 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:36.202146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fae32-a8ef-4618-b27e-083c7e3001b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:36.264481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e09fae32-a8ef-4618-b27e-083c7e3001b9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:36.265869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e09fae32-a8ef-4618-b27e-083c7e3001b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:36.340883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:36.456692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1180/2321] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:36.465937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107d516-9b29-44eb-bf5c-ce91198385d2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:36.466917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107d516-9b29-44eb-bf5c-ce91198385d2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:36.467338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107d516-9b29-44eb-bf5c-ce91198385d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:36.493425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6107d516-9b29-44eb-bf5c-ce91198385d2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:36.495324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6107d516-9b29-44eb-bf5c-ce91198385d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:36.512617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fae32-a8ef-4618-b27e-083c7e3001b9 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:36.519925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1142/2322] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:36.524989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fae32-a8ef-4618-b27e-083c7e3001b9 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:36.530815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab66a83-d11b-4b1b-bb04-2af344e7085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:36.531901 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab66a83-d11b-4b1b-bb04-2af344e7085a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:36.532464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab66a83-d11b-4b1b-bb04-2af344e7085a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:36.533021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab66a83-d11b-4b1b-bb04-2af344e7085a admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:36.533913 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab66a83-d11b-4b1b-bb04-2af344e7085a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:11:36.534417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab66a83-d11b-4b1b-bb04-2af344e7085a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:36.536634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab66a83-d11b-4b1b-bb04-2af344e7085a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:36.558351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107d516-9b29-44eb-bf5c-ce91198385d2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:36.570032 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1181/2323] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:11:36.570244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107d516-9b29-44eb-bf5c-ce91198385d2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:36.576104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba2cc2-5034-4a08-bbbf-6215a7e68d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:36.576897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba2cc2-5034-4a08-bbbf-6215a7e68d02 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:36.577357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba2cc2-5034-4a08-bbbf-6215a7e68d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:36.578530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba2cc2-5034-4a08-bbbf-6215a7e68d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:36.579675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba2cc2-5034-4a08-bbbf-6215a7e68d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:36.582574 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba2cc2-5034-4a08-bbbf-6215a7e68d02 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:36.629609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1143/2324] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:36 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:36.634666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab66a83-d11b-4b1b-bb04-2af344e7085a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:36.649291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab66a83-d11b-4b1b-bb04-2af344e7085a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:36.727149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3e1c1-c612-4eb5-a6a3-bb14a885d77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:36.727911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e1c1-c612-4eb5-a6a3-bb14a885d77e admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:36.728258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e1c1-c612-4eb5-a6a3-bb14a885d77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:36.728599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e1c1-c612-4eb5-a6a3-bb14a885d77e admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:36.729346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3e1c1-c612-4eb5-a6a3-bb14a885d77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:36.731700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3e1c1-c612-4eb5-a6a3-bb14a885d77e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:36.770395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1182/2325] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:36 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:36.778893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba2cc2-5034-4a08-bbbf-6215a7e68d02 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:36.795053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba2cc2-5034-4a08-bbbf-6215a7e68d02 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:36.805927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe742de7-2277-4d16-af9b-69c5deb15bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:36.808435 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe742de7-2277-4d16-af9b-69c5deb15bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:36.809979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe742de7-2277-4d16-af9b-69c5deb15bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:36.810326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe742de7-2277-4d16-af9b-69c5deb15bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:36.812573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe742de7-2277-4d16-af9b-69c5deb15bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:36.820093 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe742de7-2277-4d16-af9b-69c5deb15bc3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:36.847642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3e1c1-c612-4eb5-a6a3-bb14a885d77e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:36.859788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1144/2326] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:11:36.862292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3e1c1-c612-4eb5-a6a3-bb14a885d77e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:36.869381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996e815-4ac5-492f-b740-4fa3118d532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:36.870061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e815-4ac5-492f-b740-4fa3118d532c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:36.870306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e815-4ac5-492f-b740-4fa3118d532c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:36.870617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996e815-4ac5-492f-b740-4fa3118d532c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:36.871436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996e815-4ac5-492f-b740-4fa3118d532c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:36.873239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996e815-4ac5-492f-b740-4fa3118d532c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:36.906894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe742de7-2277-4d16-af9b-69c5deb15bc3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:36.907118 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1183/2327] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:11:36.910313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe742de7-2277-4d16-af9b-69c5deb15bc3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:36.915512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdefbc-d73f-4522-bbbb-6a732fb44515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:36.916248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdefbc-d73f-4522-bbbb-6a732fb44515 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:36.916535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdefbc-d73f-4522-bbbb-6a732fb44515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:36.916961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdefbc-d73f-4522-bbbb-6a732fb44515 admin admin] PATH_INFO: `/v3/projects/cf5b9dcddb1443b7986603b670f1375f/users/95a7aa7390cc4633a32a05eaf75312ba/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:36.942675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdefbc-d73f-4522-bbbb-6a732fb44515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5b9dcddb1443b7986603b670f1375f, user_id=95a7aa7390cc4633a32a05eaf75312ba, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:36.947874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdefbc-d73f-4522-bbbb-6a732fb44515 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:36.973165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1145/2328] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:36 2022] PUT /identity/v3/projects/cf5b9dcddb1443b7986603b670f1375f/users/95a7aa7390cc4633a32a05eaf75312ba/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:36.974123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375d994-8403-436a-9c85-193e12947dcf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:36.974349 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375d994-8403-436a-9c85-193e12947dcf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:36.974627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375d994-8403-436a-9c85-193e12947dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:37.025655 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a375d994-8403-436a-9c85-193e12947dcf None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:37.026961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a375d994-8403-436a-9c85-193e12947dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:37.172416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1184/2329] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:11:37.184984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdefbc-d73f-4522-bbbb-6a732fb44515 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:37.187257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-38fdefbc-d73f-4522-bbbb-6a732fb44515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:37.208242 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:37.286318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdefbc-d73f-4522-bbbb-6a732fb44515 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:37.296942 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b8fd8-7a91-432e-a868-1b3f54c51a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:37.298368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8fd8-7a91-432e-a868-1b3f54c51a18 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:37.298884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8fd8-7a91-432e-a868-1b3f54c51a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:37.316678 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b8fd8-7a91-432e-a868-1b3f54c51a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:37.331505 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b8fd8-7a91-432e-a868-1b3f54c51a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:37.333338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b8fd8-7a91-432e-a868-1b3f54c51a18 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:37.346236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1146/2330] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:41.846018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd3127-91ca-49f9-a4fc-331296a2cb79 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:41.846665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd3127-91ca-49f9-a4fc-331296a2cb79 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:41.846665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd3127-91ca-49f9-a4fc-331296a2cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:41.906238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5ecd3127-91ca-49f9-a4fc-331296a2cb79 None None] MFA Rules not processed for user `c6e85017753e4a87a560cb384bea179b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:41.907414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5ecd3127-91ca-49f9-a4fc-331296a2cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:41.983820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:42.060019 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1185/2331] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:42.064512 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b8fd8-7a91-432e-a868-1b3f54c51a18 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:42.066089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bb9b8fd8-7a91-432e-a868-1b3f54c51a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:42.089411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b8fd8-7a91-432e-a868-1b3f54c51a18 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:42.107174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e241f-269e-4b0c-9839-9c4cdc52e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:42.107800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e241f-269e-4b0c-9839-9c4cdc52e8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:42.108105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e241f-269e-4b0c-9839-9c4cdc52e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:42.108380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e241f-269e-4b0c-9839-9c4cdc52e8f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:42.109059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e241f-269e-4b0c-9839-9c4cdc52e8f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:42.111038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e241f-269e-4b0c-9839-9c4cdc52e8f1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:42.187956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1147/2332] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:42 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:42.191878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd3127-91ca-49f9-a4fc-331296a2cb79 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:42.204443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd3127-91ca-49f9-a4fc-331296a2cb79 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:42.329746 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03fa53-50a8-448e-98a9-2ddbe932f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:42.330869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03fa53-50a8-448e-98a9-2ddbe932f83e admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:42.331158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03fa53-50a8-448e-98a9-2ddbe932f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:42.332466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03fa53-50a8-448e-98a9-2ddbe932f83e admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:42.332829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03fa53-50a8-448e-98a9-2ddbe932f83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:42.337772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03fa53-50a8-448e-98a9-2ddbe932f83e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:42.371498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1186/2333] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:42 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:42.375542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e241f-269e-4b0c-9839-9c4cdc52e8f1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:42.390271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e241f-269e-4b0c-9839-9c4cdc52e8f1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:42.397482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8cbff-ff03-41e9-bcce-828293167a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:42.399415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8cbff-ff03-41e9-bcce-828293167a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:42.400265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8cbff-ff03-41e9-bcce-828293167a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:42.400924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8cbff-ff03-41e9-bcce-828293167a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:42.401998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8cbff-ff03-41e9-bcce-828293167a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:42.404687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8cbff-ff03-41e9-bcce-828293167a7b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:42.426202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1148/2334] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:42.430164 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03fa53-50a8-448e-98a9-2ddbe932f83e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:42.445199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03fa53-50a8-448e-98a9-2ddbe932f83e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:42.453233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274d91-64fe-4117-b50c-1227eca99ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:42.453233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274d91-64fe-4117-b50c-1227eca99ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:42.453233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274d91-64fe-4117-b50c-1227eca99ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:42.453233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26274d91-64fe-4117-b50c-1227eca99ef5 admin admin] PATH_INFO: `/v3/projects/1019050339b54b87be45e3c28534942f/users/f317e7a06b574eacac30f2f9f5579277/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:42.475820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26274d91-64fe-4117-b50c-1227eca99ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1019050339b54b87be45e3c28534942f, user_id=f317e7a06b574eacac30f2f9f5579277, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:42.478942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26274d91-64fe-4117-b50c-1227eca99ef5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:42.504297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1187/2335] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:42 2022] PUT /identity/v3/projects/1019050339b54b87be45e3c28534942f/users/f317e7a06b574eacac30f2f9f5579277/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:42.507396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8cbff-ff03-41e9-bcce-828293167a7b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:42.548863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8cbff-ff03-41e9-bcce-828293167a7b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:42.707281 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff6d0a6-0bbb-48e1-8de7-b3c368f5c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:42.712371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6d0a6-0bbb-48e1-8de7-b3c368f5c122 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:42.712879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6d0a6-0bbb-48e1-8de7-b3c368f5c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:42.713639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6d0a6-0bbb-48e1-8de7-b3c368f5c122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:42.716987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6d0a6-0bbb-48e1-8de7-b3c368f5c122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:42.721309 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff6d0a6-0bbb-48e1-8de7-b3c368f5c122 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:42.758697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1149/2336] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:42.762255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274d91-64fe-4117-b50c-1227eca99ef5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:42.793229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26274d91-64fe-4117-b50c-1227eca99ef5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:42.814814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326823b-5a62-4591-bc0e-8d1e50a11ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:42.815639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326823b-5a62-4591-bc0e-8d1e50a11ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:42.816625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326823b-5a62-4591-bc0e-8d1e50a11ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:42.816625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326823b-5a62-4591-bc0e-8d1e50a11ea1 admin admin] PATH_INFO: `/v3/projects/1019050339b54b87be45e3c28534942f/users/f317e7a06b574eacac30f2f9f5579277/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:42.819539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326823b-5a62-4591-bc0e-8d1e50a11ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1019050339b54b87be45e3c28534942f, user_id=f317e7a06b574eacac30f2f9f5579277, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:42.822345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326823b-5a62-4591-bc0e-8d1e50a11ea1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:42.838144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1188/2337] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:42 2022] PUT /identity/v3/projects/1019050339b54b87be45e3c28534942f/users/f317e7a06b574eacac30f2f9f5579277/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:11:46.877139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcaff9-e0d5-46d8-922a-b0640aff435b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:46.877644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcaff9-e0d5-46d8-922a-b0640aff435b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:46.878394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcaff9-e0d5-46d8-922a-b0640aff435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:46.950635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-aafcaff9-e0d5-46d8-922a-b0640aff435b None None] MFA Rules not processed for user `95a7aa7390cc4633a32a05eaf75312ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:46.951914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aafcaff9-e0d5-46d8-922a-b0640aff435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:47.046888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1150/2338] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:47.048254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326823b-5a62-4591-bc0e-8d1e50a11ea1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:47.172364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326823b-5a62-4591-bc0e-8d1e50a11ea1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:47.187071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d987073-cf03-44d6-9a47-7b61823dfa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:47.188330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d987073-cf03-44d6-9a47-7b61823dfa2b admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:47.189371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d987073-cf03-44d6-9a47-7b61823dfa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:47.189995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d987073-cf03-44d6-9a47-7b61823dfa2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:47.191235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d987073-cf03-44d6-9a47-7b61823dfa2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:47.195109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d987073-cf03-44d6-9a47-7b61823dfa2b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:47.263580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1189/2339] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:11:47 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:47.266400 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcaff9-e0d5-46d8-922a-b0640aff435b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:47.283380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:47.294174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcaff9-e0d5-46d8-922a-b0640aff435b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:47.441986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8761b-1a88-43f6-aa98-586e003159c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:47.445151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8761b-1a88-43f6-aa98-586e003159c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:47.445757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8761b-1a88-43f6-aa98-586e003159c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:47.446273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8761b-1a88-43f6-aa98-586e003159c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:47.447398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8761b-1a88-43f6-aa98-586e003159c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:47.453831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8761b-1a88-43f6-aa98-586e003159c0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:47.503222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1151/2340] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:11:47 2022] POST /identity/v3/users => generated 299 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:11:47.508015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d987073-cf03-44d6-9a47-7b61823dfa2b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:47.522477 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d987073-cf03-44d6-9a47-7b61823dfa2b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:47.541392 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471e14b-97ab-419d-81bf-ea225efca95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:47.541392 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e14b-97ab-419d-81bf-ea225efca95e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:47.541392 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e14b-97ab-419d-81bf-ea225efca95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:47.541392 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e14b-97ab-419d-81bf-ea225efca95e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:47.541759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471e14b-97ab-419d-81bf-ea225efca95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:47.541759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471e14b-97ab-419d-81bf-ea225efca95e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:47.562067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:47.577595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1190/2341] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:47.579943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8761b-1a88-43f6-aa98-586e003159c0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:47.592061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8761b-1a88-43f6-aa98-586e003159c0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:47.601696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ab476-bfaa-4865-b9d9-bafe089d9145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:47.602662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ab476-bfaa-4865-b9d9-bafe089d9145 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:47.602930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ab476-bfaa-4865-b9d9-bafe089d9145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:47.603517 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ab476-bfaa-4865-b9d9-bafe089d9145 admin admin] PATH_INFO: `/v3/projects/d01d0d4992174398a9ceeb9047b11304/users/3b9d5f8771484ca5b047ee29eef00655/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:47.627951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ab476-bfaa-4865-b9d9-bafe089d9145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01d0d4992174398a9ceeb9047b11304, user_id=3b9d5f8771484ca5b047ee29eef00655, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:47.631392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ab476-bfaa-4865-b9d9-bafe089d9145 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:47.652572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1152/2342] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:47 2022] PUT /identity/v3/projects/d01d0d4992174398a9ceeb9047b11304/users/3b9d5f8771484ca5b047ee29eef00655/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:11:47.654641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471e14b-97ab-419d-81bf-ea225efca95e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:47.666219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471e14b-97ab-419d-81bf-ea225efca95e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:47.770413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95140d5b-677d-41e7-a0f1-30c833401c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:47.771089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140d5b-677d-41e7-a0f1-30c833401c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:47.771371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140d5b-677d-41e7-a0f1-30c833401c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:47.771646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95140d5b-677d-41e7-a0f1-30c833401c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:47.772301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95140d5b-677d-41e7-a0f1-30c833401c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:47.775125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95140d5b-677d-41e7-a0f1-30c833401c2f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:47.788673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1191/2343] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:11:47.789637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ab476-bfaa-4865-b9d9-bafe089d9145 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:47.812089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ab476-bfaa-4865-b9d9-bafe089d9145 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:47.834573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84524c13-28ef-4a1a-9686-ed4b0daca0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:47.836679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84524c13-28ef-4a1a-9686-ed4b0daca0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:47.837640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84524c13-28ef-4a1a-9686-ed4b0daca0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:47.837926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84524c13-28ef-4a1a-9686-ed4b0daca0a7 admin admin] PATH_INFO: `/v3/projects/d01d0d4992174398a9ceeb9047b11304/users/3b9d5f8771484ca5b047ee29eef00655/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:47.840786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84524c13-28ef-4a1a-9686-ed4b0daca0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01d0d4992174398a9ceeb9047b11304, user_id=3b9d5f8771484ca5b047ee29eef00655, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:47.844830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84524c13-28ef-4a1a-9686-ed4b0daca0a7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:47.881867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1153/2344] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:11:47 2022] PUT /identity/v3/projects/d01d0d4992174398a9ceeb9047b11304/users/3b9d5f8771484ca5b047ee29eef00655/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:11:51.590029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4c68-39b6-4748-9e3e-570b337e72e8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:51.590941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4c68-39b6-4748-9e3e-570b337e72e8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:51.591371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4c68-39b6-4748-9e3e-570b337e72e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:51.658684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-266c4c68-39b6-4748-9e3e-570b337e72e8 None None] MFA Rules not processed for user `f317e7a06b574eacac30f2f9f5579277`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:51.660342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-266c4c68-39b6-4748-9e3e-570b337e72e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:51.850176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1192/2345] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:52.152690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84524c13-28ef-4a1a-9686-ed4b0daca0a7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:52.154832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-84524c13-28ef-4a1a-9686-ed4b0daca0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:52.299396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84524c13-28ef-4a1a-9686-ed4b0daca0a7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:52.310502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6b7d6-ecf0-4c6f-932a-95e15e6356c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:52.313430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6b7d6-ecf0-4c6f-932a-95e15e6356c1 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:52.313430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6b7d6-ecf0-4c6f-932a-95e15e6356c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:52.313430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6b7d6-ecf0-4c6f-932a-95e15e6356c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:52.447329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:52.458212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6b7d6-ecf0-4c6f-932a-95e15e6356c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:52.463174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6b7d6-ecf0-4c6f-932a-95e15e6356c1 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:52.496151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1154/2346] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:55.002174 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701d13-16b5-4049-8f39-f79a4d2ae160 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:55.003031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701d13-16b5-4049-8f39-f79a4d2ae160 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:55.003472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701d13-16b5-4049-8f39-f79a4d2ae160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:55.071633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5a701d13-16b5-4049-8f39-f79a4d2ae160 None None] MFA Rules not processed for user `3b9d5f8771484ca5b047ee29eef00655`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:55.073448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5a701d13-16b5-4049-8f39-f79a4d2ae160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:55.195436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1193/2347] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:55.212769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6b7d6-ecf0-4c6f-932a-95e15e6356c1 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:55.216183 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a3d6b7d6-ecf0-4c6f-932a-95e15e6356c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:55.317595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6b7d6-ecf0-4c6f-932a-95e15e6356c1 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:55.334624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee53808-2305-4862-81ad-aabb5c8b66e6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:55.335210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee53808-2305-4862-81ad-aabb5c8b66e6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:55.335669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee53808-2305-4862-81ad-aabb5c8b66e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:55.342531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301f797-1fcc-4c38-a375-b123d38079f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c746178628e4df5961982268e642ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:55.343513 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301f797-1fcc-4c38-a375-b123d38079f4 service glance] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:55.352830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301f797-1fcc-4c38-a375-b123d38079f4 service glance] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:55.355591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301f797-1fcc-4c38-a375-b123d38079f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:55.362699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:11:55.380524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0ee53808-2305-4862-81ad-aabb5c8b66e6 None None] MFA Rules not processed for user `c6e85017753e4a87a560cb384bea179b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:55.385549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0ee53808-2305-4862-81ad-aabb5c8b66e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:55.422490 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1194/2348] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:11:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:55.560640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301f797-1fcc-4c38-a375-b123d38079f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:55.563091 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301f797-1fcc-4c38-a375-b123d38079f4 service glance] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:55.594524 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1155/2349] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:11:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:11:56.018720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8694fe-8256-4f4f-bafa-66d642dfb75e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:56.019300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8694fe-8256-4f4f-bafa-66d642dfb75e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:56.019387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8694fe-8256-4f4f-bafa-66d642dfb75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:56.068922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6b8694fe-8256-4f4f-bafa-66d642dfb75e None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:11:56.072667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6b8694fe-8256-4f4f-bafa-66d642dfb75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:56.311395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1195/2350] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:11:56.403709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301f797-1fcc-4c38-a375-b123d38079f4 service glance] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:11:56.406316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4301f797-1fcc-4c38-a375-b123d38079f4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:11:56.627206 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301f797-1fcc-4c38-a375-b123d38079f4 service glance] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:11:56.647258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3fa6-8e74-4951-8013-07a9388e67b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:11:56.647915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3fa6-8e74-4951-8013-07a9388e67b3 service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:11:56.648198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3fa6-8e74-4951-8013-07a9388e67b3 service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:11:56.648470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3fa6-8e74-4951-8013-07a9388e67b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:11:56.659913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b3fa6-8e74-4951-8013-07a9388e67b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:11:56.661686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b3fa6-8e74-4951-8013-07a9388e67b3 service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:11:56.674005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1156/2351] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:11:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:12:01.846092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8694fe-8256-4f4f-bafa-66d642dfb75e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:01.848250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6b8694fe-8256-4f4f-bafa-66d642dfb75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:02.084814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8694fe-8256-4f4f-bafa-66d642dfb75e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:02.103170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e3b87-5b39-495a-bc40-27a81931ef9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:02.104024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3b87-5b39-495a-bc40-27a81931ef9f service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:02.104312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3b87-5b39-495a-bc40-27a81931ef9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:02.104597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3b87-5b39-495a-bc40-27a81931ef9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:02.108792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0c7e3b87-5b39-495a-bc40-27a81931ef9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:02.245662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e3b87-5b39-495a-bc40-27a81931ef9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:02.257844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e3b87-5b39-495a-bc40-27a81931ef9f service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:02.272974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1196/2352] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:02.653308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a710d0-2f29-4abc-819c-4dbea71370eb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:02.654272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a710d0-2f29-4abc-819c-4dbea71370eb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:02.654696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a710d0-2f29-4abc-819c-4dbea71370eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:02.694987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b3a710d0-2f29-4abc-819c-4dbea71370eb None None] MFA Rules not processed for user `2b29780489334bb6807674a8c4ea5239`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:02.708201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b3a710d0-2f29-4abc-819c-4dbea71370eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:02.762432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:02.809388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1157/2353] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:12:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:10.467397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811fbd-deb8-4e98-81b2-7d158605e87b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:10.467972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811fbd-deb8-4e98-81b2-7d158605e87b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:10.467972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811fbd-deb8-4e98-81b2-7d158605e87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:10.489512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-53811fbd-deb8-4e98-81b2-7d158605e87b None None] MFA Rules not processed for user `95a7aa7390cc4633a32a05eaf75312ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:10.491031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-53811fbd-deb8-4e98-81b2-7d158605e87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:10.498680 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1197/2354] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:12:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:12.799754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=8 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:13.204086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510358-74e2-4239-bab3-89ae1976558f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:13.205246 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510358-74e2-4239-bab3-89ae1976558f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:13.206004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510358-74e2-4239-bab3-89ae1976558f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:13.236293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1c510358-74e2-4239-bab3-89ae1976558f None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:13.237672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1c510358-74e2-4239-bab3-89ae1976558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:13.245985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1158/2355] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:13.265872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53811fbd-deb8-4e98-81b2-7d158605e87b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:13.279193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53811fbd-deb8-4e98-81b2-7d158605e87b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:13.284282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3f636-254b-42f9-806b-fb1d49672a63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:13.284970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f636-254b-42f9-806b-fb1d49672a63 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:13.285359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f636-254b-42f9-806b-fb1d49672a63 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:13.285700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3f636-254b-42f9-806b-fb1d49672a63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:13.294148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3f636-254b-42f9-806b-fb1d49672a63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:13.295839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3f636-254b-42f9-806b-fb1d49672a63 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:13.304799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1198/2356] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:12:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:12:23.229966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:23.300892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:25.399490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510358-74e2-4239-bab3-89ae1976558f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:25.401084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1c510358-74e2-4239-bab3-89ae1976558f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:25.472521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510358-74e2-4239-bab3-89ae1976558f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:25.481392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:25.482108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:25.482379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:25.482654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] PATH_INFO: `/v3/users/696d5661ec3a4b1d973098c14d034972` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:25.483823 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=696d5661ec3a4b1d973098c14d034972)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:25.485813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:25.533393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696d5661ec3a4b1d973098c14d034972'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:25.540558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696d5661ec3a4b1d973098c14d034972'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:25.541613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696d5661ec3a4b1d973098c14d034972'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:25.551366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696d5661ec3a4b1d973098c14d034972'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:25.552099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696d5661ec3a4b1d973098c14d034972'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:25.585236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1159/2357] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:12:25 2022] DELETE /identity/v3/users/696d5661ec3a4b1d973098c14d034972 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:12:25.882603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3f636-254b-42f9-806b-fb1d49672a63 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:25.898581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3f636-254b-42f9-806b-fb1d49672a63 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:25.984899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:25.985644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:25.985990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:25.986513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] PATH_INFO: `/v3/projects/cbf69d0ed7464a908e5016ef5fc85e77` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:25.987865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf69d0ed7464a908e5016ef5fc85e77)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:25.989966 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:26.054771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf69d0ed7464a908e5016ef5fc85e77', 'request_id': 'req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.077394 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf69d0ed7464a908e5016ef5fc85e77', 'request_id': 'req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.078387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf69d0ed7464a908e5016ef5fc85e77', 'request_id': 'req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.091880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] The token cache is being invalidate because project cbf69d0ed7464a908e5016ef5fc85e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:12:26.092174 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.092829 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.094344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1199/2358] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:12:25 2022] DELETE /identity/v3/projects/cbf69d0ed7464a908e5016ef5fc85e77 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:12:26.098320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:26.099754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:26.113166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6cad-e56c-44fb-a925-8ba7d22f7e1d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:26.185416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:26.186174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:26.187122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:26.187472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] PATH_INFO: `/v3/users/8d14814cbef64b4da28597fb147a8cd1` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:26.188872 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d14814cbef64b4da28597fb147a8cd1)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:26.191153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:26.221609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:26.255405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d14814cbef64b4da28597fb147a8cd1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.262974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d14814cbef64b4da28597fb147a8cd1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.263783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d14814cbef64b4da28597fb147a8cd1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.272141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d14814cbef64b4da28597fb147a8cd1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.272790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3fd868d4-86cb-4c8c-ab92-e910d348739a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d14814cbef64b4da28597fb147a8cd1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.290136 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1160/2359] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:12:26 2022] DELETE /identity/v3/users/8d14814cbef64b4da28597fb147a8cd1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:12:26.513776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:26.515287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:26.532313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779816c-9eb2-41b0-8c6c-bcdbd26007b8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:26.595366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:26.596016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:26.596299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:26.596573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] PATH_INFO: `/v3/projects/1d0892348abe4679a72765c4be58ba88` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:26.597732 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d0892348abe4679a72765c4be58ba88)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:26.599664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:26.638442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:26.651964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d0892348abe4679a72765c4be58ba88', 'request_id': 'req-2aa1dd50-2126-41a5-bbf8-edc753b46c55'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.657704 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d0892348abe4679a72765c4be58ba88', 'request_id': 'req-2aa1dd50-2126-41a5-bbf8-edc753b46c55'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.665762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d0892348abe4679a72765c4be58ba88', 'request_id': 'req-2aa1dd50-2126-41a5-bbf8-edc753b46c55'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.676811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] The token cache is being invalidate because project 1d0892348abe4679a72765c4be58ba88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:12:26.677098 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.677766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2aa1dd50-2126-41a5-bbf8-edc753b46c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:26.679324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1200/2360] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:12:26 2022] DELETE /identity/v3/projects/1d0892348abe4679a72765c4be58ba88 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:12:26.684499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af166e2-578d-495d-a882-aa2366bf3145 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:26.684992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af166e2-578d-495d-a882-aa2366bf3145 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:26.684992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af166e2-578d-495d-a882-aa2366bf3145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:26.706028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4af166e2-578d-495d-a882-aa2366bf3145 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:26.707249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4af166e2-578d-495d-a882-aa2366bf3145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:26.770598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1161/2361] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:26.782373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072e5b7-540c-4be3-b428-dcc263c0689f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:26.782661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072e5b7-540c-4be3-b428-dcc263c0689f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:26.782929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072e5b7-540c-4be3-b428-dcc263c0689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:26.804042 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9072e5b7-540c-4be3-b428-dcc263c0689f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:26.805287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9072e5b7-540c-4be3-b428-dcc263c0689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:26.814177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1201/2362] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:26.818479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af166e2-578d-495d-a882-aa2366bf3145 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:26.828538 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af166e2-578d-495d-a882-aa2366bf3145 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:26.834413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6762f29-7c97-4865-8aaf-59dbfbc00b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:26.835142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762f29-7c97-4865-8aaf-59dbfbc00b1d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:26.835426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762f29-7c97-4865-8aaf-59dbfbc00b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:26.835693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6762f29-7c97-4865-8aaf-59dbfbc00b1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:26.836354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6762f29-7c97-4865-8aaf-59dbfbc00b1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:12:26.836662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6762f29-7c97-4865-8aaf-59dbfbc00b1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:26.838300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6762f29-7c97-4865-8aaf-59dbfbc00b1d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:26.851301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1162/2363] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:12:26.856354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072e5b7-540c-4be3-b428-dcc263c0689f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:26.866492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072e5b7-540c-4be3-b428-dcc263c0689f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:26.872198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafac07-c686-48dd-a10d-6527a794d3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:26.872991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafac07-c686-48dd-a10d-6527a794d3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:26.873428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafac07-c686-48dd-a10d-6527a794d3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:26.873813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafac07-c686-48dd-a10d-6527a794d3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:26.874579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafac07-c686-48dd-a10d-6527a794d3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:26.876558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafac07-c686-48dd-a10d-6527a794d3f2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:26.923597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1202/2364] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:12:26 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:12:26.928202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6762f29-7c97-4865-8aaf-59dbfbc00b1d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:26.941196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6762f29-7c97-4865-8aaf-59dbfbc00b1d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:27.009650 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7c617-39db-43b8-a476-163ec5804435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:27.010262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c617-39db-43b8-a476-163ec5804435 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.010540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c617-39db-43b8-a476-163ec5804435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.010840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7c617-39db-43b8-a476-163ec5804435 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.011479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7c617-39db-43b8-a476-163ec5804435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:27.013551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7c617-39db-43b8-a476-163ec5804435 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:27.035255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1163/2365] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:12:26 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:12:27.039584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafac07-c686-48dd-a10d-6527a794d3f2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:27.051598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafac07-c686-48dd-a10d-6527a794d3f2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:27.056799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34fae-b0f5-4e3e-a718-26049c0497a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:27.057745 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34fae-b0f5-4e3e-a718-26049c0497a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.058200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34fae-b0f5-4e3e-a718-26049c0497a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.058760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34fae-b0f5-4e3e-a718-26049c0497a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.060630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f34fae-b0f5-4e3e-a718-26049c0497a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:27.062569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f34fae-b0f5-4e3e-a718-26049c0497a9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:27.073660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1203/2366] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:12:27.077901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7c617-39db-43b8-a476-163ec5804435 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:27.088107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7c617-39db-43b8-a476-163ec5804435 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:27.095006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4d5af-94e0-4696-9eb8-6e6fb25f14d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:27.095697 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4d5af-94e0-4696-9eb8-6e6fb25f14d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.096047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4d5af-94e0-4696-9eb8-6e6fb25f14d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.096390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4d5af-94e0-4696-9eb8-6e6fb25f14d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.097181 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4d5af-94e0-4696-9eb8-6e6fb25f14d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:27.098867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4d5af-94e0-4696-9eb8-6e6fb25f14d4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:27.112223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1164/2367] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:12:27.116387 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34fae-b0f5-4e3e-a718-26049c0497a9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:27.126522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34fae-b0f5-4e3e-a718-26049c0497a9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:27.131805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1fa58-5489-4d09-acfd-15c73d9437ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:27.132481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1fa58-5489-4d09-acfd-15c73d9437ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.132763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1fa58-5489-4d09-acfd-15c73d9437ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.133080 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1fa58-5489-4d09-acfd-15c73d9437ea admin admin] PATH_INFO: `/v3/projects/2692f2024422463e942a439fe5f25ee4/users/9b0f4518dfd34066902b2bc6812896e3/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.159294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1fa58-5489-4d09-acfd-15c73d9437ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2692f2024422463e942a439fe5f25ee4, user_id=9b0f4518dfd34066902b2bc6812896e3, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:27.162094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1fa58-5489-4d09-acfd-15c73d9437ea admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:27.175810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1204/2368] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:12:27 2022] PUT /identity/v3/projects/2692f2024422463e942a439fe5f25ee4/users/9b0f4518dfd34066902b2bc6812896e3/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:12:27.249558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c565b-2c54-4354-8a2b-410bf668ac28 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.250011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c565b-2c54-4354-8a2b-410bf668ac28 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.250379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c565b-2c54-4354-8a2b-410bf668ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.261274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:27.289788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4d4c565b-2c54-4354-8a2b-410bf668ac28 None None] MFA Rules not processed for user `9b0f4518dfd34066902b2bc6812896e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:27.291028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4d4c565b-2c54-4354-8a2b-410bf668ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:27.382948 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1165/2369] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:12:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:27.387561 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1fa58-5489-4d09-acfd-15c73d9437ea admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:27.455532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1fa58-5489-4d09-acfd-15c73d9437ea admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:27.460589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33a4f0-11b8-47da-9dbb-7af69463b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:27.461336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33a4f0-11b8-47da-9dbb-7af69463b8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.461679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33a4f0-11b8-47da-9dbb-7af69463b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.461994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33a4f0-11b8-47da-9dbb-7af69463b8e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.462634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33a4f0-11b8-47da-9dbb-7af69463b8e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:27.464558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33a4f0-11b8-47da-9dbb-7af69463b8e7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:27.493777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1205/2370] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:12:27 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:12:27.498817 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c565b-2c54-4354-8a2b-410bf668ac28 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:27.510586 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c565b-2c54-4354-8a2b-410bf668ac28 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:27.568807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb1eb-3f6b-4842-a7e7-969317324f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:27.569515 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb1eb-3f6b-4842-a7e7-969317324f73 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.569794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb1eb-3f6b-4842-a7e7-969317324f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.570061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fb1eb-3f6b-4842-a7e7-969317324f73 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.570700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fb1eb-3f6b-4842-a7e7-969317324f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:27.572683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fb1eb-3f6b-4842-a7e7-969317324f73 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:27.595530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1166/2371] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:12:27 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:12:27.599803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33a4f0-11b8-47da-9dbb-7af69463b8e7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:27.610925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33a4f0-11b8-47da-9dbb-7af69463b8e7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:27.616515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7802db9-624f-4957-9534-5f1c9434a804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:27.617197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7802db9-624f-4957-9534-5f1c9434a804 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.617481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7802db9-624f-4957-9534-5f1c9434a804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.617800 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7802db9-624f-4957-9534-5f1c9434a804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.618423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7802db9-624f-4957-9534-5f1c9434a804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:27.620033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7802db9-624f-4957-9534-5f1c9434a804 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:27.639311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1206/2372] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:12:27.643079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb1eb-3f6b-4842-a7e7-969317324f73 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:27.655861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fb1eb-3f6b-4842-a7e7-969317324f73 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:27.663110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ae944-3f18-4160-a300-79abb77c4913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:27.664668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ae944-3f18-4160-a300-79abb77c4913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.664957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ae944-3f18-4160-a300-79abb77c4913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.665298 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ae944-3f18-4160-a300-79abb77c4913 admin admin] PATH_INFO: `/v3/projects/a243596549794fa8b39c72338541daae/users/706299d9e46f4cb4a8370296bbf5b2d5/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.691941 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ae944-3f18-4160-a300-79abb77c4913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a243596549794fa8b39c72338541daae, user_id=706299d9e46f4cb4a8370296bbf5b2d5, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:27.695362 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ae944-3f18-4160-a300-79abb77c4913 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:27.710325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1167/2373] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:12:27 2022] PUT /identity/v3/projects/a243596549794fa8b39c72338541daae/users/706299d9e46f4cb4a8370296bbf5b2d5/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:12:27.714721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7802db9-624f-4957-9534-5f1c9434a804 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:27.725102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7802db9-624f-4957-9534-5f1c9434a804 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:27.764665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:27.812290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffbf23-3b24-42c5-ae03-751bee49447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:27.813449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffbf23-3b24-42c5-ae03-751bee49447f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.814154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffbf23-3b24-42c5-ae03-751bee49447f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.814630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffbf23-3b24-42c5-ae03-751bee49447f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.815548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffbf23-3b24-42c5-ae03-751bee49447f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:27.817659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffbf23-3b24-42c5-ae03-751bee49447f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:27.830742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1207/2374] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:12:27.835322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ae944-3f18-4160-a300-79abb77c4913 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:27.849437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ae944-3f18-4160-a300-79abb77c4913 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:27.855366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3c8ad-fc00-4ce1-b1e1-94b3ec4ca50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:27.856639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3c8ad-fc00-4ce1-b1e1-94b3ec4ca50d admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.857175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3c8ad-fc00-4ce1-b1e1-94b3ec4ca50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.858069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3c8ad-fc00-4ce1-b1e1-94b3ec4ca50d admin admin] PATH_INFO: `/v3/projects/a243596549794fa8b39c72338541daae/users/706299d9e46f4cb4a8370296bbf5b2d5/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.860753 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3c8ad-fc00-4ce1-b1e1-94b3ec4ca50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a243596549794fa8b39c72338541daae, user_id=706299d9e46f4cb4a8370296bbf5b2d5, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:27.864526 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3c8ad-fc00-4ce1-b1e1-94b3ec4ca50d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:27.879994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1168/2375] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:12:27 2022] PUT /identity/v3/projects/a243596549794fa8b39c72338541daae/users/706299d9e46f4cb4a8370296bbf5b2d5/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:12:27.891010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5269-9a0a-4808-873e-fabc33214530 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:27.891490 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5269-9a0a-4808-873e-fabc33214530 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:27.892062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd5269-9a0a-4808-873e-fabc33214530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:27.923780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dacd5269-9a0a-4808-873e-fabc33214530 None None] MFA Rules not processed for user `706299d9e46f4cb4a8370296bbf5b2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:27.925621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dacd5269-9a0a-4808-873e-fabc33214530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:28.012539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1208/2376] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:12:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:28.023903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3c8ad-fc00-4ce1-b1e1-94b3ec4ca50d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:28.025796 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-63f3c8ad-fc00-4ce1-b1e1-94b3ec4ca50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:28.085569 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:28.092353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3c8ad-fc00-4ce1-b1e1-94b3ec4ca50d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:28.100856 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa3c53-073c-4483-899f-19764d4b582b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:28.101620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa3c53-073c-4483-899f-19764d4b582b service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:28.102414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa3c53-073c-4483-899f-19764d4b582b service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:28.103120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa3c53-073c-4483-899f-19764d4b582b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:28.198444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa3c53-073c-4483-899f-19764d4b582b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:28.200071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa3c53-073c-4483-899f-19764d4b582b service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:28.212393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1169/2377] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:29.212706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e099-dfef-427d-881e-278c9b94f19f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:29.213582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e099-dfef-427d-881e-278c9b94f19f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:29.213582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e099-dfef-427d-881e-278c9b94f19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:29.246873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5797e099-dfef-427d-881e-278c9b94f19f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:29.248123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5797e099-dfef-427d-881e-278c9b94f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:29.311284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1209/2378] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:29.331614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa3c53-073c-4483-899f-19764d4b582b service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:29.333094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-80fa3c53-073c-4483-899f-19764d4b582b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:29.411385 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa3c53-073c-4483-899f-19764d4b582b service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:29.416745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a74201-0eec-41ea-a243-a270cc488a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:29.418334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a74201-0eec-41ea-a243-a270cc488a79 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:29.418666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a74201-0eec-41ea-a243-a270cc488a79 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:29.418880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a74201-0eec-41ea-a243-a270cc488a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:29.427509 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a74201-0eec-41ea-a243-a270cc488a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:29.429116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a74201-0eec-41ea-a243-a270cc488a79 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:29.438751 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1170/2379] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:30.888664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797e099-dfef-427d-881e-278c9b94f19f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:30.898975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797e099-dfef-427d-881e-278c9b94f19f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:30.904733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:30.905455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:30.905737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:30.906016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] PATH_INFO: `/v3/users/9b0f4518dfd34066902b2bc6812896e3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:30.907190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0f4518dfd34066902b2bc6812896e3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:30.909205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:30.958692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0f4518dfd34066902b2bc6812896e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:30.959439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0f4518dfd34066902b2bc6812896e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:30.960694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:30.974664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0f4518dfd34066902b2bc6812896e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:30.989379 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0f4518dfd34066902b2bc6812896e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:30.990099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0f4518dfd34066902b2bc6812896e3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.002511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1210/2380] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:12:30 2022] DELETE /identity/v3/users/9b0f4518dfd34066902b2bc6812896e3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:12:31.007601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4fa3b-3a8d-4eae-b456-cf7f6c4cf5b2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:31.008098 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4fa3b-3a8d-4eae-b456-cf7f6c4cf5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:31.008209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4fa3b-3a8d-4eae-b456-cf7f6c4cf5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:31.027880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1fc4fa3b-3a8d-4eae-b456-cf7f6c4cf5b2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:31.029145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1fc4fa3b-3a8d-4eae-b456-cf7f6c4cf5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:31.152928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1171/2381] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:31.160845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:31.162431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:31.220590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e83fa-35ed-4db8-bfc9-b95daa7ae5b1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:31.226673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303c8a-4e5f-4d89-9151-f12b73675a34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:31.227378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303c8a-4e5f-4d89-9151-f12b73675a34 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:31.227726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303c8a-4e5f-4d89-9151-f12b73675a34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:31.228066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75303c8a-4e5f-4d89-9151-f12b73675a34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:31.241472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75303c8a-4e5f-4d89-9151-f12b73675a34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:31.243185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75303c8a-4e5f-4d89-9151-f12b73675a34 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:31.257245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1211/2382] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:31.539189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4fa3b-3a8d-4eae-b456-cf7f6c4cf5b2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:31.540632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1fc4fa3b-3a8d-4eae-b456-cf7f6c4cf5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:31.558155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4fa3b-3a8d-4eae-b456-cf7f6c4cf5b2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:31.564208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:31.564985 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:31.565194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:31.565445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] PATH_INFO: `/v3/projects/2692f2024422463e942a439fe5f25ee4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:31.566711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2692f2024422463e942a439fe5f25ee4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:31.568844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:31.593054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:31.619483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2692f2024422463e942a439fe5f25ee4', 'request_id': 'req-05993ae7-82c2-44a8-aafa-cd0531c26c39'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.625454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2692f2024422463e942a439fe5f25ee4', 'request_id': 'req-05993ae7-82c2-44a8-aafa-cd0531c26c39'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.635516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2692f2024422463e942a439fe5f25ee4', 'request_id': 'req-05993ae7-82c2-44a8-aafa-cd0531c26c39'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.648270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] The token cache is being invalidate because project 2692f2024422463e942a439fe5f25ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:12:31.648555 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.649332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-05993ae7-82c2-44a8-aafa-cd0531c26c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.651265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1172/2383] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:12:31 2022] DELETE /identity/v3/projects/2692f2024422463e942a439fe5f25ee4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:12:31.655613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303c8a-4e5f-4d89-9151-f12b73675a34 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:31.665674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75303c8a-4e5f-4d89-9151-f12b73675a34 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:31.725200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:31.725861 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:31.726135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:31.726402 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] PATH_INFO: `/v3/users/706299d9e46f4cb4a8370296bbf5b2d5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:31.727557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=706299d9e46f4cb4a8370296bbf5b2d5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:31.729521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:31.786597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '706299d9e46f4cb4a8370296bbf5b2d5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.787335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '706299d9e46f4cb4a8370296bbf5b2d5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.800546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '706299d9e46f4cb4a8370296bbf5b2d5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.804578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:31.809887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '706299d9e46f4cb4a8370296bbf5b2d5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.811363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '706299d9e46f4cb4a8370296bbf5b2d5'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:31.826614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1212/2384] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:12:31 2022] DELETE /identity/v3/users/706299d9e46f4cb4a8370296bbf5b2d5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:12:32.310992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aebf30-75d5-450b-af78-d597a4890359 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:32.311684 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aebf30-75d5-450b-af78-d597a4890359 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:32.311684 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aebf30-75d5-450b-af78-d597a4890359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:32.336693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c4aebf30-75d5-450b-af78-d597a4890359 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:32.338218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c4aebf30-75d5-450b-af78-d597a4890359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:32.470856 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1173/2385] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:32.582576 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:32.583109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aebf30-75d5-450b-af78-d597a4890359 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:32.584183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:32.584476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c4aebf30-75d5-450b-af78-d597a4890359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:32.618563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aebf30-75d5-450b-af78-d597a4890359 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:32.624183 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:32.624980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:32.625739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:32.625855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] PATH_INFO: `/v3/projects/a243596549794fa8b39c72338541daae` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:32.627576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a243596549794fa8b39c72338541daae)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:32.630498 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:32.702119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a243596549794fa8b39c72338541daae', 'request_id': 'req-24f6091c-8802-4b49-8217-c08234d7293a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:32.710029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a243596549794fa8b39c72338541daae', 'request_id': 'req-24f6091c-8802-4b49-8217-c08234d7293a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:32.729537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a243596549794fa8b39c72338541daae', 'request_id': 'req-24f6091c-8802-4b49-8217-c08234d7293a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:32.752653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] The token cache is being invalidate because project a243596549794fa8b39c72338541daae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:12:32.753117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:32.754588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-24f6091c-8802-4b49-8217-c08234d7293a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:12:32.755925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e18fd4-1462-4b1b-be9e-7190afcd3881 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:32.756987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1174/2386] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:12:32 2022] DELETE /identity/v3/projects/a243596549794fa8b39c72338541daae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:12:32.762852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c6e1b-8f48-48ae-8d6d-a91018e5b2fe None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:32.763134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c6e1b-8f48-48ae-8d6d-a91018e5b2fe None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:32.763734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c6e1b-8f48-48ae-8d6d-a91018e5b2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:32.796232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-688c6e1b-8f48-48ae-8d6d-a91018e5b2fe None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:32.797495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-688c6e1b-8f48-48ae-8d6d-a91018e5b2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:32.838089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161f99a-b482-4b20-8af3-06481e584c9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:32.838989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161f99a-b482-4b20-8af3-06481e584c9d service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:32.839739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161f99a-b482-4b20-8af3-06481e584c9d service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:32.840153 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161f99a-b482-4b20-8af3-06481e584c9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:32.842812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5161f99a-b482-4b20-8af3-06481e584c9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:32.864582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:32.929408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1175/2387] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:12:32.942600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da9746-69ce-4521-bf0d-96e0979877f1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:32.942883 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da9746-69ce-4521-bf0d-96e0979877f1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:32.943154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da9746-69ce-4521-bf0d-96e0979877f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:32.945014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161f99a-b482-4b20-8af3-06481e584c9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:32.946790 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161f99a-b482-4b20-8af3-06481e584c9d service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:32.968353 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1213/2388] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:32.999387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-73da9746-69ce-4521-bf0d-96e0979877f1 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:33.000613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-73da9746-69ce-4521-bf0d-96e0979877f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:33.012325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1176/2389] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:33.014129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161f99a-b482-4b20-8af3-06481e584c9d service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:33.024937 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161f99a-b482-4b20-8af3-06481e584c9d service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:33.031391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f3f96-0d56-4cd7-9471-082b2c590cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:33.032396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f3f96-0d56-4cd7-9471-082b2c590cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:33.032820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f3f96-0d56-4cd7-9471-082b2c590cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:33.033263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f3f96-0d56-4cd7-9471-082b2c590cd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:33.034084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f3f96-0d56-4cd7-9471-082b2c590cd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:12:33.034529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f3f96-0d56-4cd7-9471-082b2c590cd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:33.037771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f3f96-0d56-4cd7-9471-082b2c590cd6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:33.051607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1214/2390] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:12:33.057374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da9746-69ce-4521-bf0d-96e0979877f1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:33.069936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da9746-69ce-4521-bf0d-96e0979877f1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:33.077968 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e73f08-57e1-4e94-903b-ef1eed500f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:33.078928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e73f08-57e1-4e94-903b-ef1eed500f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:33.079508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e73f08-57e1-4e94-903b-ef1eed500f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:33.080881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e73f08-57e1-4e94-903b-ef1eed500f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:33.081747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e73f08-57e1-4e94-903b-ef1eed500f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:33.084593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e73f08-57e1-4e94-903b-ef1eed500f57 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:33.117117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1177/2391] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:12:33 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:12:33.121317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f3f96-0d56-4cd7-9471-082b2c590cd6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:33.128969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:33.135303 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f3f96-0d56-4cd7-9471-082b2c590cd6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:33.224075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecba5fc-81ab-4f07-8e80-4b685b3166b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:33.224823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba5fc-81ab-4f07-8e80-4b685b3166b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:33.225251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba5fc-81ab-4f07-8e80-4b685b3166b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:33.225751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba5fc-81ab-4f07-8e80-4b685b3166b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:33.226484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecba5fc-81ab-4f07-8e80-4b685b3166b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:33.228583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecba5fc-81ab-4f07-8e80-4b685b3166b7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:33.263066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1215/2392] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:12:33 2022] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:12:33.267490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e73f08-57e1-4e94-903b-ef1eed500f57 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:33.278729 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e73f08-57e1-4e94-903b-ef1eed500f57 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:33.283348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9590e-48da-468e-99df-11375fba270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:33.283975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9590e-48da-468e-99df-11375fba270d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:33.284780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9590e-48da-468e-99df-11375fba270d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:33.284780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9590e-48da-468e-99df-11375fba270d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:33.285208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9590e-48da-468e-99df-11375fba270d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:33.287043 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9590e-48da-468e-99df-11375fba270d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:33.300152 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1178/2393] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:12:33.301650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecba5fc-81ab-4f07-8e80-4b685b3166b7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:33.312356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecba5fc-81ab-4f07-8e80-4b685b3166b7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:33.317138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02483789-5650-4352-b31c-17437cb4893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:33.317791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483789-5650-4352-b31c-17437cb4893f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:33.318265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483789-5650-4352-b31c-17437cb4893f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:33.318464 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483789-5650-4352-b31c-17437cb4893f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:33.319082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483789-5650-4352-b31c-17437cb4893f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:33.320729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483789-5650-4352-b31c-17437cb4893f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:33.332759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1216/2394] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:12:33.336739 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9590e-48da-468e-99df-11375fba270d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:33.348843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9590e-48da-468e-99df-11375fba270d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:33.354540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ad6fa-c253-4625-a38d-3567b1145f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:33.355418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ad6fa-c253-4625-a38d-3567b1145f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:33.356565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ad6fa-c253-4625-a38d-3567b1145f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:33.357000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ad6fa-c253-4625-a38d-3567b1145f67 admin admin] PATH_INFO: `/v3/projects/f99f3ac81d8d47f49a3847af0774d7cd/users/f9ff0420d0514a5db65306908212ae6c/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:33.376313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ad6fa-c253-4625-a38d-3567b1145f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99f3ac81d8d47f49a3847af0774d7cd, user_id=f9ff0420d0514a5db65306908212ae6c, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:33.380377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ad6fa-c253-4625-a38d-3567b1145f67 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:33.395337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1179/2395] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:12:33 2022] PUT /identity/v3/projects/f99f3ac81d8d47f49a3847af0774d7cd/users/f9ff0420d0514a5db65306908212ae6c/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:12:33.405605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd5304-e2b5-4f56-b742-f0999c2bdeb1 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:33.405897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd5304-e2b5-4f56-b742-f0999c2bdeb1 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:33.406177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd5304-e2b5-4f56-b742-f0999c2bdeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:33.447625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-40cd5304-e2b5-4f56-b742-f0999c2bdeb1 None None] MFA Rules not processed for user `f9ff0420d0514a5db65306908212ae6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:33.449652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-40cd5304-e2b5-4f56-b742-f0999c2bdeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:33.529750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1217/2396] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:12:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:33.541884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ad6fa-c253-4625-a38d-3567b1145f67 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:33.543621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-670ad6fa-c253-4625-a38d-3567b1145f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:33.606689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ad6fa-c253-4625-a38d-3567b1145f67 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:33.611314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c605-d726-4b67-9c4b-4b17954b5758 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c746178628e4df5961982268e642ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:33.612000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c605-d726-4b67-9c4b-4b17954b5758 service glance] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:33.612395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c605-d726-4b67-9c4b-4b17954b5758 service glance] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:33.612730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422c605-d726-4b67-9c4b-4b17954b5758 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:33.625600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422c605-d726-4b67-9c4b-4b17954b5758 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:33.627304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422c605-d726-4b67-9c4b-4b17954b5758 service glance] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:33.645389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1180/2397] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:36.665147 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348547c5-9881-4dee-b64c-5b6b554ee43b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:36.665624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348547c5-9881-4dee-b64c-5b6b554ee43b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:36.665824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348547c5-9881-4dee-b64c-5b6b554ee43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:36.691237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-348547c5-9881-4dee-b64c-5b6b554ee43b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:36.692574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-348547c5-9881-4dee-b64c-5b6b554ee43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:36.753779 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1218/2398] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:36.770378 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c605-d726-4b67-9c4b-4b17954b5758 service glance] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:36.773443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8422c605-d726-4b67-9c4b-4b17954b5758 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:36.853383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422c605-d726-4b67-9c4b-4b17954b5758 service glance] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:36.859394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8bc9-6aa4-4f4e-b93a-04a88b1aea5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:36.860026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8bc9-6aa4-4f4e-b93a-04a88b1aea5f service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:36.860229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8bc9-6aa4-4f4e-b93a-04a88b1aea5f service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:36.860525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8bc9-6aa4-4f4e-b93a-04a88b1aea5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:36.870069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f8bc9-6aa4-4f4e-b93a-04a88b1aea5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:36.871723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f8bc9-6aa4-4f4e-b93a-04a88b1aea5f service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:36.876036 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:36.883361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1181/2399] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:41.801262 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5e8b3-efc8-4c5d-ac0e-f65f6b3fa345 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:41.801853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5e8b3-efc8-4c5d-ac0e-f65f6b3fa345 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:41.801853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5e8b3-efc8-4c5d-ac0e-f65f6b3fa345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:41.826260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0dc5e8b3-efc8-4c5d-ac0e-f65f6b3fa345 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:41.827771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0dc5e8b3-efc8-4c5d-ac0e-f65f6b3fa345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:41.844586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1219/2400] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:41.928979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8bc9-6aa4-4f4e-b93a-04a88b1aea5f service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:41.942625 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8bc9-6aa4-4f4e-b93a-04a88b1aea5f service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:41.949099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a24e9-f0d0-44b9-8049-b3df982dfecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:41.949940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a24e9-f0d0-44b9-8049-b3df982dfecd service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:41.950214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a24e9-f0d0-44b9-8049-b3df982dfecd service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:41.950602 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a24e9-f0d0-44b9-8049-b3df982dfecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:41.962748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a24e9-f0d0-44b9-8049-b3df982dfecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:41.964395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a24e9-f0d0-44b9-8049-b3df982dfecd service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:41.974670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1182/2401] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:45.979665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95537f-263a-42cd-abce-2ca279851214 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:45.980208 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95537f-263a-42cd-abce-2ca279851214 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:45.980208 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95537f-263a-42cd-abce-2ca279851214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:45.998712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:12:46.005279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2e95537f-263a-42cd-abce-2ca279851214 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:46.007195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2e95537f-263a-42cd-abce-2ca279851214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:46.016559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1220/2402] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:46.033434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a24e9-f0d0-44b9-8049-b3df982dfecd service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:46.035056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-939a24e9-f0d0-44b9-8049-b3df982dfecd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:46.051634 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a24e9-f0d0-44b9-8049-b3df982dfecd service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:46.057668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0e404-4387-4cad-8ca6-1a3096e63ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:46.058300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0e404-4387-4cad-8ca6-1a3096e63ffd service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:46.058576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0e404-4387-4cad-8ca6-1a3096e63ffd service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:46.058851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0e404-4387-4cad-8ca6-1a3096e63ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:46.068312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0e404-4387-4cad-8ca6-1a3096e63ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:46.070000 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0e404-4387-4cad-8ca6-1a3096e63ffd service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:46.081323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1183/2403] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:46.718106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95537f-263a-42cd-abce-2ca279851214 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:46.719676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2e95537f-263a-42cd-abce-2ca279851214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:46.776832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95537f-263a-42cd-abce-2ca279851214 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:46.780586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccf26c-9afb-46f6-a957-bfd3bc0050d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:46.781245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccf26c-9afb-46f6-a957-bfd3bc0050d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:46.781522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccf26c-9afb-46f6-a957-bfd3bc0050d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:46.781796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccf26c-9afb-46f6-a957-bfd3bc0050d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:46.783672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-83ccf26c-9afb-46f6-a957-bfd3bc0050d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:46.854409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccf26c-9afb-46f6-a957-bfd3bc0050d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:46.855870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccf26c-9afb-46f6-a957-bfd3bc0050d8 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:46.865959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1221/2404] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:49.964056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79113-adff-4d10-9359-9902eff60d47 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:49.964560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79113-adff-4d10-9359-9902eff60d47 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:49.964673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79113-adff-4d10-9359-9902eff60d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:49.984359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a4e79113-adff-4d10-9359-9902eff60d47 None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:49.985633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a4e79113-adff-4d10-9359-9902eff60d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:50.053626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1184/2405] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:12:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:12:50.066891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccf26c-9afb-46f6-a957-bfd3bc0050d8 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:50.068329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-83ccf26c-9afb-46f6-a957-bfd3bc0050d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:50.235478 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccf26c-9afb-46f6-a957-bfd3bc0050d8 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:50.250689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ce598-a2fd-4dc6-8b76-199decbe3980 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:50.251345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ce598-a2fd-4dc6-8b76-199decbe3980 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:50.251622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ce598-a2fd-4dc6-8b76-199decbe3980 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:50.251894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ce598-a2fd-4dc6-8b76-199decbe3980 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:50.271369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b142-96a7-4fd2-9cd5-0c426936348f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:50.271803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b142-96a7-4fd2-9cd5-0c426936348f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:50.272473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39b142-96a7-4fd2-9cd5-0c426936348f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:50.274027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ce598-a2fd-4dc6-8b76-199decbe3980 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:50.277596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ce598-a2fd-4dc6-8b76-199decbe3980 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:50.297763 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1a39b142-96a7-4fd2-9cd5-0c426936348f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:12:50.300158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1a39b142-96a7-4fd2-9cd5-0c426936348f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:50.300738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1222/2406] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:12:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:12:50.317287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1185/2407] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:12:50.558106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ce598-a2fd-4dc6-8b76-199decbe3980 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:50.577641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ce598-a2fd-4dc6-8b76-199decbe3980 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:50.590202 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1aaf7-f458-4711-8011-eaf397d763bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:50.592839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1aaf7-f458-4711-8011-eaf397d763bc service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:50.593630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1aaf7-f458-4711-8011-eaf397d763bc service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:50.594323 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1aaf7-f458-4711-8011-eaf397d763bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:50.612664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1aaf7-f458-4711-8011-eaf397d763bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:50.616485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1aaf7-f458-4711-8011-eaf397d763bc service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:50.667751 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1223/2408] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:12:51.379590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b142-96a7-4fd2-9cd5-0c426936348f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:12:51.381723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1a39b142-96a7-4fd2-9cd5-0c426936348f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:51.398290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39b142-96a7-4fd2-9cd5-0c426936348f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:12:51.410658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb650478-5236-4a88-ac87-2dcc8d6153ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:12:51.411610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb650478-5236-4a88-ac87-2dcc8d6153ed service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:12:51.414115 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb650478-5236-4a88-ac87-2dcc8d6153ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:12:51.414580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb650478-5236-4a88-ac87-2dcc8d6153ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:12:51.419009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cb650478-5236-4a88-ac87-2dcc8d6153ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:12:51.564815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb650478-5236-4a88-ac87-2dcc8d6153ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:12:51.567723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb650478-5236-4a88-ac87-2dcc8d6153ed service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:12:51.590894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1186/2409] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:12:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:13:00.632293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:13:01.574007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=71 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:13:02.292776 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1aaf7-f458-4711-8011-eaf397d763bc service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:02.303142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1aaf7-f458-4711-8011-eaf397d763bc service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:02.310256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:02.310899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:02.311182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:02.311454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] PATH_INFO: `/v3/users/f9ff0420d0514a5db65306908212ae6c` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:02.312731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ff0420d0514a5db65306908212ae6c)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:02.314737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:02.368803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ff0420d0514a5db65306908212ae6c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:13:02.369527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ff0420d0514a5db65306908212ae6c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:13:02.385947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ff0420d0514a5db65306908212ae6c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:13:02.397229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ff0420d0514a5db65306908212ae6c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:13:02.398006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ff0420d0514a5db65306908212ae6c'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:13:02.411900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1224/2410] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:13:02 2022] DELETE /identity/v3/users/f9ff0420d0514a5db65306908212ae6c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:13:02.416584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18da5a7-5034-427d-9717-aa615c308de0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:02.416955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18da5a7-5034-427d-9717-aa615c308de0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:02.417463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18da5a7-5034-427d-9717-aa615c308de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:02.438108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a18da5a7-5034-427d-9717-aa615c308de0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:02.439413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a18da5a7-5034-427d-9717-aa615c308de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:02.502469 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1187/2411] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:02.512987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:02.514539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:02.576843 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c6c4-aff1-4406-a426-6eaa64cf4e17 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:02.581406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588821b3-65e2-4e09-9855-5633529f6d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:02.582031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588821b3-65e2-4e09-9855-5633529f6d02 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:02.582311 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588821b3-65e2-4e09-9855-5633529f6d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:02.582584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588821b3-65e2-4e09-9855-5633529f6d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:02.593125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588821b3-65e2-4e09-9855-5633529f6d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:02.594585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588821b3-65e2-4e09-9855-5633529f6d02 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:02.605080 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1225/2412] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:13:02.966913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18da5a7-5034-427d-9717-aa615c308de0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:02.968392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a18da5a7-5034-427d-9717-aa615c308de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:02.980429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18da5a7-5034-427d-9717-aa615c308de0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:02.990285 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:02.990945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:02.991225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:02.991502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] PATH_INFO: `/v3/projects/f99f3ac81d8d47f49a3847af0774d7cd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:02.992636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99f3ac81d8d47f49a3847af0774d7cd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:02.994658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:03.047022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99f3ac81d8d47f49a3847af0774d7cd', 'request_id': 'req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:13:03.053322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99f3ac81d8d47f49a3847af0774d7cd', 'request_id': 'req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:13:03.061709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99f3ac81d8d47f49a3847af0774d7cd', 'request_id': 'req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:13:03.073618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] The token cache is being invalidate because project f99f3ac81d8d47f49a3847af0774d7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:13:03.073904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:13:03.074537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b42e22c0-d9c0-4ff9-9b5f-e74c3c51bdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:13:03.082389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1188/2413] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:13:02 2022] DELETE /identity/v3/projects/f99f3ac81d8d47f49a3847af0774d7cd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:13:07.434643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151f959-5be0-4ff8-9afc-6936b0156a22 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:07.435241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151f959-5be0-4ff8-9afc-6936b0156a22 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:07.435241 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151f959-5be0-4ff8-9afc-6936b0156a22 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:07.436565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1226/2414] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:13:07.443442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e05a-a3d8-4a66-b67e-39be986d2113 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:07.443937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e05a-a3d8-4a66-b67e-39be986d2113 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:07.444311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0e05a-a3d8-4a66-b67e-39be986d2113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:07.465534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-33d0e05a-a3d8-4a66-b67e-39be986d2113 None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:07.466767 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-33d0e05a-a3d8-4a66-b67e-39be986d2113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:07.547391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1189/2415] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:07.558593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151f959-5be0-4ff8-9afc-6936b0156a22 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:07.560624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9151f959-5be0-4ff8-9afc-6936b0156a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:07.619046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151f959-5be0-4ff8-9afc-6936b0156a22 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:07.622718 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c05b7-6c43-429a-aac5-4ed69b9e2e1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c746178628e4df5961982268e642ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:07.623331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c05b7-6c43-429a-aac5-4ed69b9e2e1e service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:07.623608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c05b7-6c43-429a-aac5-4ed69b9e2e1e service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:07.623875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c05b7-6c43-429a-aac5-4ed69b9e2e1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:07.634557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c05b7-6c43-429a-aac5-4ed69b9e2e1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:07.636034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c05b7-6c43-429a-aac5-4ed69b9e2e1e service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:07.647158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1227/2416] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:13:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:13:07.729063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc90e3-a8b4-4806-961d-eb84e6244741 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:07.729387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc90e3-a8b4-4806-961d-eb84e6244741 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:07.729760 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc90e3-a8b4-4806-961d-eb84e6244741 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:07.731793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1190/2417] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:13:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:13:07.737218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327639-4eb1-491e-b4f8-9a1b740f4900 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:07.737623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327639-4eb1-491e-b4f8-9a1b740f4900 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:07.737999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327639-4eb1-491e-b4f8-9a1b740f4900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:07.759882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c4327639-4eb1-491e-b4f8-9a1b740f4900 None None] MFA Rules not processed for user `da4a83dd0cb64e219bc16f8cf0b0af57`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:07.761085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c4327639-4eb1-491e-b4f8-9a1b740f4900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:07.774493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:13:07.818812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1228/2418] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:13:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:07.831464 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc90e3-a8b4-4806-961d-eb84e6244741 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:07.833642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a8fc90e3-a8b4-4806-961d-eb84e6244741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:07.848636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc90e3-a8b4-4806-961d-eb84e6244741 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:07.852726 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325567b-5654-4e93-919e-f1afb769a8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:07.853363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325567b-5654-4e93-919e-f1afb769a8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:07.853639 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325567b-5654-4e93-919e-f1afb769a8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:07.853909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325567b-5654-4e93-919e-f1afb769a8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:07.861251 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325567b-5654-4e93-919e-f1afb769a8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:07.862703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325567b-5654-4e93-919e-f1afb769a8e5 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:07.871629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1191/2419] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:13:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:13:07.961909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be788a-b867-410e-90f4-6ec11f4afd75 None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:07.962235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be788a-b867-410e-90f4-6ec11f4afd75 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:07.962507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be788a-b867-410e-90f4-6ec11f4afd75 None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:07.963874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1229/2420] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:13:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:13:07.969614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6364e-def4-4d8f-a6ca-f9fe0b55181d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:07.969897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6364e-def4-4d8f-a6ca-f9fe0b55181d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:07.970180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6364e-def4-4d8f-a6ca-f9fe0b55181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:07.978917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:13:07.993628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-45f6364e-def4-4d8f-a6ca-f9fe0b55181d None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:07.994851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-45f6364e-def4-4d8f-a6ca-f9fe0b55181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:08.004877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1192/2421] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:08.015522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be788a-b867-410e-90f4-6ec11f4afd75 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:08.027904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be788a-b867-410e-90f4-6ec11f4afd75 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:08.032003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c834b-0c95-4556-b8f2-8462d3c985b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:08.032599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c834b-0c95-4556-b8f2-8462d3c985b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:08.032879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c834b-0c95-4556-b8f2-8462d3c985b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:08.033181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c834b-0c95-4556-b8f2-8462d3c985b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:08.044059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c834b-0c95-4556-b8f2-8462d3c985b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:08.045559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c834b-0c95-4556-b8f2-8462d3c985b1 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:08.056298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1230/2422] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:13:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:13:08.990034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6364e-def4-4d8f-a6ca-f9fe0b55181d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:08.991618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-45f6364e-def4-4d8f-a6ca-f9fe0b55181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:09.066302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6364e-def4-4d8f-a6ca-f9fe0b55181d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:09.071838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163f858-e9c3-4d6a-ae15-0c489b640cf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4716f9539151414dadd9e4b8f13ffc0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:09.072441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163f858-e9c3-4d6a-ae15-0c489b640cf0 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:09.072803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163f858-e9c3-4d6a-ae15-0c489b640cf0 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:09.073050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163f858-e9c3-4d6a-ae15-0c489b640cf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:09.075011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f163f858-e9c3-4d6a-ae15-0c489b640cf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:09.086987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163f858-e9c3-4d6a-ae15-0c489b640cf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:09.088605 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163f858-e9c3-4d6a-ae15-0c489b640cf0 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:09.098539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1193/2423] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:13:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:13:10.652140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeb673-d775-4600-980c-a3c9c2bbbf80 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:10.652644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeb673-d775-4600-980c-a3c9c2bbbf80 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:10.652644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeb673-d775-4600-980c-a3c9c2bbbf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:10.674281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f9aeb673-d775-4600-980c-a3c9c2bbbf80 None None] MFA Rules not processed for user `089996c73f3c49bf902e6ca639242e65`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:10.675603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f9aeb673-d775-4600-980c-a3c9c2bbbf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:10.743771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1231/2424] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:13:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:11.337853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e0d8-3264-45b2-8ba3-718e89a9b0fe None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:11.338714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e0d8-3264-45b2-8ba3-718e89a9b0fe None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:11.339160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4e0d8-3264-45b2-8ba3-718e89a9b0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:11.360541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-92e4e0d8-3264-45b2-8ba3-718e89a9b0fe None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:11.361798 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-92e4e0d8-3264-45b2-8ba3-718e89a9b0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:11.436980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1194/2425] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:13:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:11.445945 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeb673-d775-4600-980c-a3c9c2bbbf80 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:11.447386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f9aeb673-d775-4600-980c-a3c9c2bbbf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:11.524559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeb673-d775-4600-980c-a3c9c2bbbf80 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:11.530021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edb838-2980-4ea8-9f18-1ad8078b3894 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:11.530766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edb838-2980-4ea8-9f18-1ad8078b3894 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:11.530964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edb838-2980-4ea8-9f18-1ad8078b3894 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:11.531339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edb838-2980-4ea8-9f18-1ad8078b3894 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:11.539712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edb838-2980-4ea8-9f18-1ad8078b3894 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:11.541320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edb838-2980-4ea8-9f18-1ad8078b3894 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:11.550388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1232/2426] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:13:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 17:13:21.419946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=59 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:13:21.547149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=78 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:13:31.098183 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d0ac-764e-438d-ab6c-7d198a1cbaee None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:31.098641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d0ac-764e-438d-ab6c-7d198a1cbaee None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:31.098738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d0ac-764e-438d-ab6c-7d198a1cbaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:31.119250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cfb3d0ac-764e-438d-ab6c-7d198a1cbaee None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:31.120441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cfb3d0ac-764e-438d-ab6c-7d198a1cbaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:31.127786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1195/2427] 10.222.0.76 () {58 vars in 967 bytes} [Mon Sep 19 17:13:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:31.140982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edb838-2980-4ea8-9f18-1ad8078b3894 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:31.151925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edb838-2980-4ea8-9f18-1ad8078b3894 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:31.157012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b366c-ae85-4223-af6d-cdea929ba9ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:31.157660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b366c-ae85-4223-af6d-cdea929ba9ea service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:31.157940 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b366c-ae85-4223-af6d-cdea929ba9ea service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:31.158214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b366c-ae85-4223-af6d-cdea929ba9ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:31.166636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b366c-ae85-4223-af6d-cdea929ba9ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:31.168214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b366c-ae85-4223-af6d-cdea929ba9ea service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:31.176699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1233/2428] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:13:38.370627 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63219d9-7226-4274-8ddb-04b114b3cbba None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:38.371146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63219d9-7226-4274-8ddb-04b114b3cbba None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:38.371146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63219d9-7226-4274-8ddb-04b114b3cbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:38.392418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e63219d9-7226-4274-8ddb-04b114b3cbba None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:38.393696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e63219d9-7226-4274-8ddb-04b114b3cbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:38.454345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1196/2429] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:38.471915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b366c-ae85-4223-af6d-cdea929ba9ea service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:38.473422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a63b366c-ae85-4223-af6d-cdea929ba9ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:38.489287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b366c-ae85-4223-af6d-cdea929ba9ea service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:38.495106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c3cb-2b34-478f-b093-391e7131006e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:38.495705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c3cb-2b34-478f-b093-391e7131006e service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:38.495981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c3cb-2b34-478f-b093-391e7131006e service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:38.496249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c3cb-2b34-478f-b093-391e7131006e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:38.505720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7c3cb-2b34-478f-b093-391e7131006e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:38.507292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7c3cb-2b34-478f-b093-391e7131006e service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:38.517191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1234/2430] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:13:41.659601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373ac1f-e8f4-43bf-abe9-074f338aa0dd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:41.660170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373ac1f-e8f4-43bf-abe9-074f338aa0dd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:41.660170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373ac1f-e8f4-43bf-abe9-074f338aa0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:41.682331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f373ac1f-e8f4-43bf-abe9-074f338aa0dd None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:41.683603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f373ac1f-e8f4-43bf-abe9-074f338aa0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:41.693142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1197/2431] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:41.718271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c3cb-2b34-478f-b093-391e7131006e service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:41.730850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c3cb-2b34-478f-b093-391e7131006e service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:41.736989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574166a5-cf23-45d9-9674-8dbba5e6772b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:41.737638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574166a5-cf23-45d9-9674-8dbba5e6772b service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:41.737942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574166a5-cf23-45d9-9674-8dbba5e6772b service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:41.738204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574166a5-cf23-45d9-9674-8dbba5e6772b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:41.746710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574166a5-cf23-45d9-9674-8dbba5e6772b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:41.748324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574166a5-cf23-45d9-9674-8dbba5e6772b service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:41.758457 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1235/2432] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:13:44.750267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87296a-5dcd-4bbd-a69b-d4fa140d29f2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:44.750747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87296a-5dcd-4bbd-a69b-d4fa140d29f2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:44.750861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87296a-5dcd-4bbd-a69b-d4fa140d29f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:44.770731 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5f87296a-5dcd-4bbd-a69b-d4fa140d29f2 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:44.771920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5f87296a-5dcd-4bbd-a69b-d4fa140d29f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:44.780288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1198/2433] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:44.799669 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574166a5-cf23-45d9-9674-8dbba5e6772b service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:44.801228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-574166a5-cf23-45d9-9674-8dbba5e6772b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:44.816453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574166a5-cf23-45d9-9674-8dbba5e6772b service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:44.823398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f1a1e-a92f-476f-98b7-5cafc6a0d5b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:44.824007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f1a1e-a92f-476f-98b7-5cafc6a0d5b0 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:44.824286 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f1a1e-a92f-476f-98b7-5cafc6a0d5b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:44.824599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f1a1e-a92f-476f-98b7-5cafc6a0d5b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:44.833318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f1a1e-a92f-476f-98b7-5cafc6a0d5b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:44.834899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f1a1e-a92f-476f-98b7-5cafc6a0d5b0 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:44.844633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1236/2434] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:13:47.917462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7069d76-5a37-488e-b5d5-87e0f287cc06 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:47.917986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7069d76-5a37-488e-b5d5-87e0f287cc06 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:47.918097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7069d76-5a37-488e-b5d5-87e0f287cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:47.943352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b7069d76-5a37-488e-b5d5-87e0f287cc06 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:47.944552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b7069d76-5a37-488e-b5d5-87e0f287cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:47.953326 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1199/2435] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:47.969438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f1a1e-a92f-476f-98b7-5cafc6a0d5b0 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:47.981298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f1a1e-a92f-476f-98b7-5cafc6a0d5b0 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:47.988430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806107f7-bac1-471b-afee-0d1ef6d82c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:47.989076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806107f7-bac1-471b-afee-0d1ef6d82c96 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:47.989367 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806107f7-bac1-471b-afee-0d1ef6d82c96 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:47.989629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806107f7-bac1-471b-afee-0d1ef6d82c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:47.998189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806107f7-bac1-471b-afee-0d1ef6d82c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:47.999754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806107f7-bac1-471b-afee-0d1ef6d82c96 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:48.009656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1237/2436] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:13:51.079758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a22f-6090-4cc4-bce7-dbbaf966c95d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:51.080343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a22f-6090-4cc4-bce7-dbbaf966c95d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:51.080343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131a22f-6090-4cc4-bce7-dbbaf966c95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:51.100370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1131a22f-6090-4cc4-bce7-dbbaf966c95d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:13:51.101577 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1131a22f-6090-4cc4-bce7-dbbaf966c95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:13:51.110028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1200/2437] 10.222.0.52 () {58 vars in 1016 bytes} [Mon Sep 19 17:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:13:51.131612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806107f7-bac1-471b-afee-0d1ef6d82c96 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:13:51.143743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806107f7-bac1-471b-afee-0d1ef6d82c96 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:13:51.150589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee62d8e-2c90-4989-a44a-a8d24cba48d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:13:51.151198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee62d8e-2c90-4989-a44a-a8d24cba48d5 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:13:51.151478 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee62d8e-2c90-4989-a44a-a8d24cba48d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:13:51.151752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee62d8e-2c90-4989-a44a-a8d24cba48d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:13:51.160479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee62d8e-2c90-4989-a44a-a8d24cba48d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:13:51.162108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee62d8e-2c90-4989-a44a-a8d24cba48d5 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:13:51.171728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1238/2438] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:14:01.094771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=42 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:14:01.137071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2897e47-5395-419b-98f2-eee69983e078 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:14:01.137456 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2897e47-5395-419b-98f2-eee69983e078 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:14:01.137821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2897e47-5395-419b-98f2-eee69983e078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:14:01.158024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d2897e47-5395-419b-98f2-eee69983e078 None None] MFA Rules not processed for user `2b29780489334bb6807674a8c4ea5239`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:14:01.159245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d2897e47-5395-419b-98f2-eee69983e078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:14:01.167252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=36 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:14:01.227421 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1201/2439] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:14:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:14:11.216169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=25 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:14:24.137971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee62d8e-2c90-4989-a44a-a8d24cba48d5 service nova] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:14:24.139700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7ee62d8e-2c90-4989-a44a-a8d24cba48d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:14:24.161549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee62d8e-2c90-4989-a44a-a8d24cba48d5 service nova] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:14:24.165932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:14:24.166682 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:14:24.167079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:14:24.167440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] PATH_INFO: `/v3/users/089996c73f3c49bf902e6ca639242e65` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:14:24.168651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089996c73f3c49bf902e6ca639242e65)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:14:24.171044 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:14:24.222629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089996c73f3c49bf902e6ca639242e65'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:14:24.223831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089996c73f3c49bf902e6ca639242e65'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:14:24.238914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089996c73f3c49bf902e6ca639242e65'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:14:24.247332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089996c73f3c49bf902e6ca639242e65'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:14:24.248037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-102fd5f0-f2e5-4926-ae83-d03892cbc195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089996c73f3c49bf902e6ca639242e65'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:14:24.265287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1239/2440] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:14:24 2022] DELETE /identity/v3/users/089996c73f3c49bf902e6ca639242e65 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:14:24.459627 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2897e47-5395-419b-98f2-eee69983e078 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:14:24.476505 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2897e47-5395-419b-98f2-eee69983e078 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:14:24.549347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:14:24.550747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:14:24.550747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:14:24.551042 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] PATH_INFO: `/v3/projects/59b969778e2e4ac4a85f170e33ff7bb0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:14:24.552423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b969778e2e4ac4a85f170e33ff7bb0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:14:24.554535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:14:24.616644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b969778e2e4ac4a85f170e33ff7bb0', 'request_id': 'req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:14:24.632736 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b969778e2e4ac4a85f170e33ff7bb0', 'request_id': 'req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:14:24.652411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b969778e2e4ac4a85f170e33ff7bb0', 'request_id': 'req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:14:24.652823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c9804-de25-4c46-b540-95b03d829283 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:14:24.653660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c9804-de25-4c46-b540-95b03d829283 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:14:24.654079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c9804-de25-4c46-b540-95b03d829283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:14:24.666278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] The token cache is being invalidate because project 59b969778e2e4ac4a85f170e33ff7bb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:14:24.666574 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:14:24.667283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3821c82f-c5fe-4dbb-b6fb-14d9bfd1ab82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:14:24.669085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1202/2441] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:14:24 2022] DELETE /identity/v3/projects/59b969778e2e4ac4a85f170e33ff7bb0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:14:24.678997 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3e3c9804-de25-4c46-b540-95b03d829283 None None] MFA Rules not processed for user `58005342342744a98bbfe8ed97ad151b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:14:24.680775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3e3c9804-de25-4c46-b540-95b03d829283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:14:24.753590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1240/2442] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:14:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:14:26.141744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fe9bf-8d54-437e-8e6f-052b082ae4be None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:14:26.142138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fe9bf-8d54-437e-8e6f-052b082ae4be None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:14:26.142282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fe9bf-8d54-437e-8e6f-052b082ae4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:14:26.163215 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bb5fe9bf-8d54-437e-8e6f-052b082ae4be None None] MFA Rules not processed for user `ca12607363574ef0a0a721533e676824`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:14:26.164417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bb5fe9bf-8d54-437e-8e6f-052b082ae4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:14:26.220773 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1203/2443] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:14:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:14:34.744860 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:14:36.213669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:14:54.764533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7b3f-71f8-4984-acc8-e04545030910 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:14:54.765022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7b3f-71f8-4984-acc8-e04545030910 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:14:54.765149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7b3f-71f8-4984-acc8-e04545030910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:14:54.784199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-642f7b3f-71f8-4984-acc8-e04545030910 None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:14:54.785372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-642f7b3f-71f8-4984-acc8-e04545030910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:14:54.840248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1241/2444] 10.222.0.76 () {58 vars in 967 bytes} [Mon Sep 19 17:14:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:14:54.900204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fe9bf-8d54-437e-8e6f-052b082ae4be None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:14:54.901921 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bb5fe9bf-8d54-437e-8e6f-052b082ae4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:14:54.972164 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fe9bf-8d54-437e-8e6f-052b082ae4be None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:14:54.977264 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1fd84-8d80-46b9-a477-d5982e91a1f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:14:54.977868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1fd84-8d80-46b9-a477-d5982e91a1f3 service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:14:54.978148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1fd84-8d80-46b9-a477-d5982e91a1f3 service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:14:54.978389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1fd84-8d80-46b9-a477-d5982e91a1f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:14:54.986523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1fd84-8d80-46b9-a477-d5982e91a1f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:14:54.988113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1fd84-8d80-46b9-a477-d5982e91a1f3 service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:14:54.996137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1204/2445] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:14:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:15:02.427632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7b3f-71f8-4984-acc8-e04545030910 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:02.430039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-642f7b3f-71f8-4984-acc8-e04545030910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:02.515935 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7b3f-71f8-4984-acc8-e04545030910 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:02.520721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:02.521479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:02.522501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:02.522839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] PATH_INFO: `/v3/users/95a7aa7390cc4633a32a05eaf75312ba` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:02.524075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a7aa7390cc4633a32a05eaf75312ba)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:02.526360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:02.579258 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a7aa7390cc4633a32a05eaf75312ba'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:02.579936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a7aa7390cc4633a32a05eaf75312ba'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:02.592155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a7aa7390cc4633a32a05eaf75312ba'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:02.600753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a7aa7390cc4633a32a05eaf75312ba'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:02.601414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a7aa7390cc4633a32a05eaf75312ba'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:02.614343 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1242/2446] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:15:02 2022] DELETE /identity/v3/users/95a7aa7390cc4633a32a05eaf75312ba => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:02.791491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1fd84-8d80-46b9-a477-d5982e91a1f3 service swift] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:02.803808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1fd84-8d80-46b9-a477-d5982e91a1f3 service swift] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:02.863186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:02.863878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:02.864161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:02.864465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] PATH_INFO: `/v3/projects/cf5b9dcddb1443b7986603b670f1375f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:02.865744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5b9dcddb1443b7986603b670f1375f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:02.867720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:02.921184 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5b9dcddb1443b7986603b670f1375f', 'request_id': 'req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:02.929207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5b9dcddb1443b7986603b670f1375f', 'request_id': 'req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:02.938475 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5b9dcddb1443b7986603b670f1375f', 'request_id': 'req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:02.950033 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] The token cache is being invalidate because project cf5b9dcddb1443b7986603b670f1375f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:15:02.950319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:02.950963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:02.952462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1205/2447] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:15:02 2022] DELETE /identity/v3/projects/cf5b9dcddb1443b7986603b670f1375f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:02.956594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:02.958019 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:02.971253 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584fbbb-0b2d-44c3-9dd0-5c19cf44ffc6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:02.992614 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:03.031879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:03.032515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:03.032795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:03.033104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] PATH_INFO: `/v3/users/3b9d5f8771484ca5b047ee29eef00655` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:03.034232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9d5f8771484ca5b047ee29eef00655)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:03.036165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:03.085073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9d5f8771484ca5b047ee29eef00655'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:03.085734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9d5f8771484ca5b047ee29eef00655'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:03.098111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9d5f8771484ca5b047ee29eef00655'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:03.106361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9d5f8771484ca5b047ee29eef00655'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:03.106982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9d5f8771484ca5b047ee29eef00655'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:03.119633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1243/2448] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:15:02 2022] DELETE /identity/v3/users/3b9d5f8771484ca5b047ee29eef00655 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:15:03.317833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:03.319372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:03.335446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b3a4e-3d7f-44e1-a9ee-3740f04bb676 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:03.353114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:03.396101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:03.396740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:03.397022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:03.397323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] PATH_INFO: `/v3/projects/d01d0d4992174398a9ceeb9047b11304` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:03.398466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d01d0d4992174398a9ceeb9047b11304)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:03.400383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:03.447403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd01d0d4992174398a9ceeb9047b11304', 'request_id': 'req-f1242b01-79a5-4924-82c8-87fb6f3909b5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:03.452794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd01d0d4992174398a9ceeb9047b11304', 'request_id': 'req-f1242b01-79a5-4924-82c8-87fb6f3909b5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:03.460479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd01d0d4992174398a9ceeb9047b11304', 'request_id': 'req-f1242b01-79a5-4924-82c8-87fb6f3909b5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:03.471458 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] The token cache is being invalidate because project d01d0d4992174398a9ceeb9047b11304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:15:03.471747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:03.472397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:03.473993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1206/2449] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:15:03 2022] DELETE /identity/v3/projects/d01d0d4992174398a9ceeb9047b11304 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:05.555554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:05.557964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:05.622242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0887709-a9ab-41e6-9674-d14c69766597 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:05.671705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78811635-2524-4403-b500-f9d2bb82d696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:05.672414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78811635-2524-4403-b500-f9d2bb82d696 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:05.672700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78811635-2524-4403-b500-f9d2bb82d696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:05.672967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78811635-2524-4403-b500-f9d2bb82d696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:05.674920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-78811635-2524-4403-b500-f9d2bb82d696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:05.687887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:05.746906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78811635-2524-4403-b500-f9d2bb82d696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:05.748366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78811635-2524-4403-b500-f9d2bb82d696 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:05.760307 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1244/2450] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:07.177409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:07.179096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:07.192656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1242b01-79a5-4924-82c8-87fb6f3909b5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:07.196696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29b922-62dc-46b4-8d62-9bf69982b071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:07.197327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29b922-62dc-46b4-8d62-9bf69982b071 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:07.197613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29b922-62dc-46b4-8d62-9bf69982b071 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:07.197882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29b922-62dc-46b4-8d62-9bf69982b071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:07.199788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3f29b922-62dc-46b4-8d62-9bf69982b071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:07.264689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29b922-62dc-46b4-8d62-9bf69982b071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:07.266233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29b922-62dc-46b4-8d62-9bf69982b071 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:07.276104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1207/2451] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:08.128093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78811635-2524-4403-b500-f9d2bb82d696 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:08.129850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-78811635-2524-4403-b500-f9d2bb82d696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:08.141906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78811635-2524-4403-b500-f9d2bb82d696 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:08.146360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e127d8f-e7c6-44b9-a416-532c6da78745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:08.146991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e127d8f-e7c6-44b9-a416-532c6da78745 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:08.147266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e127d8f-e7c6-44b9-a416-532c6da78745 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:08.147541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e127d8f-e7c6-44b9-a416-532c6da78745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:08.150252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1e127d8f-e7c6-44b9-a416-532c6da78745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:08.165246 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e127d8f-e7c6-44b9-a416-532c6da78745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:08.166695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e127d8f-e7c6-44b9-a416-532c6da78745 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:08.178569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1245/2452] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:10.650051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29b922-62dc-46b4-8d62-9bf69982b071 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:10.651612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3f29b922-62dc-46b4-8d62-9bf69982b071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:10.664701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29b922-62dc-46b4-8d62-9bf69982b071 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:10.669677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:10.670320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:10.670601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:10.670873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] PATH_INFO: `/v3/users/2b29780489334bb6807674a8c4ea5239` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:10.672201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b29780489334bb6807674a8c4ea5239)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:10.674186 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:10.723928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:10.731236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b29780489334bb6807674a8c4ea5239'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:10.738831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b29780489334bb6807674a8c4ea5239'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:10.739500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b29780489334bb6807674a8c4ea5239'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:10.747732 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b29780489334bb6807674a8c4ea5239'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:10.748397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-41a346d0-afe0-45e2-9dfd-3e57ec0cc930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b29780489334bb6807674a8c4ea5239'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:10.766338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1208/2453] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:15:10 2022] DELETE /identity/v3/users/2b29780489334bb6807674a8c4ea5239 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:15:10.947463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e127d8f-e7c6-44b9-a416-532c6da78745 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:10.959196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e127d8f-e7c6-44b9-a416-532c6da78745 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:11.029870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:11.030514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.030795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.031076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] PATH_INFO: `/v3/projects/2ffb1146669b4d0fa34a117d378d30cd` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.032239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffb1146669b4d0fa34a117d378d30cd)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:11.034265 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:11.083533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffb1146669b4d0fa34a117d378d30cd', 'request_id': 'req-01aa8c95-3a11-454f-b08a-581d9ef7f71f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:11.089701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffb1146669b4d0fa34a117d378d30cd', 'request_id': 'req-01aa8c95-3a11-454f-b08a-581d9ef7f71f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:11.099780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffb1146669b4d0fa34a117d378d30cd', 'request_id': 'req-01aa8c95-3a11-454f-b08a-581d9ef7f71f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:11.111694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] The token cache is being invalidate because project 2ffb1146669b4d0fa34a117d378d30cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:15:11.111987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:11.112651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-01aa8c95-3a11-454f-b08a-581d9ef7f71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:11.114245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1246/2454] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:15:10 2022] DELETE /identity/v3/projects/2ffb1146669b4d0fa34a117d378d30cd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:11.120198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a58124-b9ce-4099-9d8d-3ef97417b36c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.120514 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a58124-b9ce-4099-9d8d-3ef97417b36c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.120788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a58124-b9ce-4099-9d8d-3ef97417b36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.143584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f8a58124-b9ce-4099-9d8d-3ef97417b36c None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:11.145548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f8a58124-b9ce-4099-9d8d-3ef97417b36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:11.207119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1209/2455] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:11.215279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77eff-724f-4bd6-9c73-6421dac30bbb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.215570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77eff-724f-4bd6-9c73-6421dac30bbb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.215911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d77eff-724f-4bd6-9c73-6421dac30bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.236149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-01d77eff-724f-4bd6-9c73-6421dac30bbb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:11.238036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-01d77eff-724f-4bd6-9c73-6421dac30bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:11.245574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1247/2456] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:11.249968 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a58124-b9ce-4099-9d8d-3ef97417b36c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:11.261803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a58124-b9ce-4099-9d8d-3ef97417b36c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:11.266595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b1a5b-1e8d-42b9-b118-ad1ed3f54da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:11.267211 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b1a5b-1e8d-42b9-b118-ad1ed3f54da1 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.267490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b1a5b-1e8d-42b9-b118-ad1ed3f54da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.267762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b1a5b-1e8d-42b9-b118-ad1ed3f54da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.268415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b1a5b-1e8d-42b9-b118-ad1ed3f54da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:15:11.268719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b1a5b-1e8d-42b9-b118-ad1ed3f54da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:11.270365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b1a5b-1e8d-42b9-b118-ad1ed3f54da1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:11.282454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1210/2457] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:15:11.286880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d77eff-724f-4bd6-9c73-6421dac30bbb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:11.296711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d77eff-724f-4bd6-9c73-6421dac30bbb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:11.301764 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27515fd-b9a4-4d10-a39a-fb271b334f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:11.302372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27515fd-b9a4-4d10-a39a-fb271b334f9c admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.302662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27515fd-b9a4-4d10-a39a-fb271b334f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.302927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27515fd-b9a4-4d10-a39a-fb271b334f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.303564 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27515fd-b9a4-4d10-a39a-fb271b334f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:11.305568 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27515fd-b9a4-4d10-a39a-fb271b334f9c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:11.315329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:11.336137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1248/2458] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:15:11 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:15:11.340621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b1a5b-1e8d-42b9-b118-ad1ed3f54da1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:11.351286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b1a5b-1e8d-42b9-b118-ad1ed3f54da1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:11.412207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a837e7-9bd8-4ad8-ab32-4a507cadbac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:11.412761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a837e7-9bd8-4ad8-ab32-4a507cadbac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.413069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a837e7-9bd8-4ad8-ab32-4a507cadbac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.413347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a837e7-9bd8-4ad8-ab32-4a507cadbac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.414025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a837e7-9bd8-4ad8-ab32-4a507cadbac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:11.416003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a837e7-9bd8-4ad8-ab32-4a507cadbac8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:11.442389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1211/2459] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:15:11 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:15:11.446874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27515fd-b9a4-4d10-a39a-fb271b334f9c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:11.458084 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27515fd-b9a4-4d10-a39a-fb271b334f9c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:11.465446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2f28-ba12-4aba-b7ed-3180444d3170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:11.466273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2f28-ba12-4aba-b7ed-3180444d3170 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.466636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2f28-ba12-4aba-b7ed-3180444d3170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.467001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2f28-ba12-4aba-b7ed-3180444d3170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.468141 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2f28-ba12-4aba-b7ed-3180444d3170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:11.470249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2f28-ba12-4aba-b7ed-3180444d3170 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:11.480333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1249/2460] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:15:11.484684 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a837e7-9bd8-4ad8-ab32-4a507cadbac8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:11.495122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a837e7-9bd8-4ad8-ab32-4a507cadbac8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:11.500095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6300f-93b5-4c64-ba6d-270279f3dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:11.500812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6300f-93b5-4c64-ba6d-270279f3dd25 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.501124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6300f-93b5-4c64-ba6d-270279f3dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.501765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6300f-93b5-4c64-ba6d-270279f3dd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.502415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6300f-93b5-4c64-ba6d-270279f3dd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:11.504014 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6300f-93b5-4c64-ba6d-270279f3dd25 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:11.514902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1212/2461] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:15:11.518980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2f28-ba12-4aba-b7ed-3180444d3170 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:11.529242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2f28-ba12-4aba-b7ed-3180444d3170 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:11.534499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61026598-57ce-410a-8693-f0bae3a9d33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:11.535149 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61026598-57ce-410a-8693-f0bae3a9d33b admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.535429 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61026598-57ce-410a-8693-f0bae3a9d33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.535705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61026598-57ce-410a-8693-f0bae3a9d33b admin admin] PATH_INFO: `/v3/projects/02e9fffaa2cb4162b825e9ddd41a303b/users/280f3adaa6e045a0bd77e61b42414a55/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.550875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61026598-57ce-410a-8693-f0bae3a9d33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e9fffaa2cb4162b825e9ddd41a303b, user_id=280f3adaa6e045a0bd77e61b42414a55, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:11.553597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61026598-57ce-410a-8693-f0bae3a9d33b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:11.568460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1250/2462] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:15:11 2022] PUT /identity/v3/projects/02e9fffaa2cb4162b825e9ddd41a303b/users/280f3adaa6e045a0bd77e61b42414a55/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:11.578703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0e74a-2625-466b-9c92-b0b77aace604 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.578936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0e74a-2625-466b-9c92-b0b77aace604 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.579202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0e74a-2625-466b-9c92-b0b77aace604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.607302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2fd0e74a-2625-466b-9c92-b0b77aace604 None None] MFA Rules not processed for user `280f3adaa6e045a0bd77e61b42414a55`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:11.608495 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2fd0e74a-2625-466b-9c92-b0b77aace604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:11.618778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:11.676921 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1213/2463] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:11.688572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61026598-57ce-410a-8693-f0bae3a9d33b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:11.690544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-61026598-57ce-410a-8693-f0bae3a9d33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:11.796735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61026598-57ce-410a-8693-f0bae3a9d33b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:11.802734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501a722-4668-4153-94e4-74187a17adf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:11.803359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501a722-4668-4153-94e4-74187a17adf6 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:11.803639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501a722-4668-4153-94e4-74187a17adf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:11.804465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501a722-4668-4153-94e4-74187a17adf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:11.813369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501a722-4668-4153-94e4-74187a17adf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:11.815361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501a722-4668-4153-94e4-74187a17adf6 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:11.825851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1251/2464] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:17.075540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0e74a-2625-466b-9c92-b0b77aace604 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:17.152016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0e74a-2625-466b-9c92-b0b77aace604 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:17.158673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:17.159323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:17.159599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:17.160229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] PATH_INFO: `/v3/users/280f3adaa6e045a0bd77e61b42414a55` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:17.161511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280f3adaa6e045a0bd77e61b42414a55)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:17.163511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:17.218455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280f3adaa6e045a0bd77e61b42414a55'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:17.225681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280f3adaa6e045a0bd77e61b42414a55'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:17.226373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280f3adaa6e045a0bd77e61b42414a55'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:17.234850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280f3adaa6e045a0bd77e61b42414a55'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:17.235569 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280f3adaa6e045a0bd77e61b42414a55'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:17.254653 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1214/2465] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:15:17 2022] DELETE /identity/v3/users/280f3adaa6e045a0bd77e61b42414a55 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:17.261436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4faa6-471e-4ef4-99be-51760a46b3bf None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:17.261910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4faa6-471e-4ef4-99be-51760a46b3bf None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:17.262047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4faa6-471e-4ef4-99be-51760a46b3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:17.289019 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-eda4faa6-471e-4ef4-99be-51760a46b3bf None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:17.290279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-eda4faa6-471e-4ef4-99be-51760a46b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:17.355809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1252/2466] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:17.365695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:17.367202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:17.406086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:17.432197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb069ff-37a0-4ee5-968e-f334a8332a37 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:17.435953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe41f84-4664-45d7-b6e6-1a4992417000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:17.436560 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe41f84-4664-45d7-b6e6-1a4992417000 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:17.436836 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe41f84-4664-45d7-b6e6-1a4992417000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:17.437138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe41f84-4664-45d7-b6e6-1a4992417000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:17.446144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe41f84-4664-45d7-b6e6-1a4992417000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:17.447565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe41f84-4664-45d7-b6e6-1a4992417000 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:17.458286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1215/2467] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:17.739636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4faa6-471e-4ef4-99be-51760a46b3bf None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:17.741601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-eda4faa6-471e-4ef4-99be-51760a46b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:17.757445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4faa6-471e-4ef4-99be-51760a46b3bf None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:17.763607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:17.764338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:17.764670 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:17.765011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] PATH_INFO: `/v3/projects/02e9fffaa2cb4162b825e9ddd41a303b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:17.766269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e9fffaa2cb4162b825e9ddd41a303b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:17.768319 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:17.811995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:17.824029 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e9fffaa2cb4162b825e9ddd41a303b', 'request_id': 'req-28fb2221-7255-4a9a-b109-e5bb6ff0f498'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:17.830514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e9fffaa2cb4162b825e9ddd41a303b', 'request_id': 'req-28fb2221-7255-4a9a-b109-e5bb6ff0f498'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:17.841621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e9fffaa2cb4162b825e9ddd41a303b', 'request_id': 'req-28fb2221-7255-4a9a-b109-e5bb6ff0f498'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:17.854922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] The token cache is being invalidate because project 02e9fffaa2cb4162b825e9ddd41a303b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:15:17.855212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:17.855863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-28fb2221-7255-4a9a-b109-e5bb6ff0f498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:17.860698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1253/2468] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:15:17 2022] DELETE /identity/v3/projects/02e9fffaa2cb4162b825e9ddd41a303b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:17.862175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148f229-84d1-4154-b092-7c3419c4351b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:17.862484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148f229-84d1-4154-b092-7c3419c4351b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:17.862754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148f229-84d1-4154-b092-7c3419c4351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:17.891779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3148f229-84d1-4154-b092-7c3419c4351b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:17.892990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3148f229-84d1-4154-b092-7c3419c4351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:17.952905 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1216/2469] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:17.960841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47d3c9-3bf5-4635-a7a3-e07749be608d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:17.961180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47d3c9-3bf5-4635-a7a3-e07749be608d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:17.961442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47d3c9-3bf5-4635-a7a3-e07749be608d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:17.982550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-5f47d3c9-3bf5-4635-a7a3-e07749be608d None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:17.983727 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-5f47d3c9-3bf5-4635-a7a3-e07749be608d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:17.991999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1254/2470] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:17.996592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148f229-84d1-4154-b092-7c3419c4351b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.007312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148f229-84d1-4154-b092-7c3419c4351b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.012026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9f8ca-3d25-4297-96e9-8ed58ec0a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.012662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9f8ca-3d25-4297-96e9-8ed58ec0a9fd admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.012946 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9f8ca-3d25-4297-96e9-8ed58ec0a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.013251 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9f8ca-3d25-4297-96e9-8ed58ec0a9fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.013908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9f8ca-3d25-4297-96e9-8ed58ec0a9fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:15:18.014213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9f8ca-3d25-4297-96e9-8ed58ec0a9fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.015831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9f8ca-3d25-4297-96e9-8ed58ec0a9fd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.028598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1217/2471] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:15:18.034093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47d3c9-3bf5-4635-a7a3-e07749be608d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.043449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47d3c9-3bf5-4635-a7a3-e07749be608d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.048202 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cfdca-b96d-467b-9ecd-43986d598811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.048904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cfdca-b96d-467b-9ecd-43986d598811 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.049329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cfdca-b96d-467b-9ecd-43986d598811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.049677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cfdca-b96d-467b-9ecd-43986d598811 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.050417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cfdca-b96d-467b-9ecd-43986d598811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.052542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cfdca-b96d-467b-9ecd-43986d598811 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.084617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1255/2472] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:15:18 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:15:18.085961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9f8ca-3d25-4297-96e9-8ed58ec0a9fd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.096490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9f8ca-3d25-4297-96e9-8ed58ec0a9fd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.150607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6fad7-b6ae-44e6-8aa1-023ec2524933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.151441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6fad7-b6ae-44e6-8aa1-023ec2524933 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.151573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6fad7-b6ae-44e6-8aa1-023ec2524933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.151809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6fad7-b6ae-44e6-8aa1-023ec2524933 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.152438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6fad7-b6ae-44e6-8aa1-023ec2524933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.154414 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6fad7-b6ae-44e6-8aa1-023ec2524933 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.178202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1218/2473] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:15:18 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:15:18.182427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cfdca-b96d-467b-9ecd-43986d598811 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.192953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cfdca-b96d-467b-9ecd-43986d598811 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.198055 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237091-d10c-4ee3-ac56-51f45d804024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.198655 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237091-d10c-4ee3-ac56-51f45d804024 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.198934 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237091-d10c-4ee3-ac56-51f45d804024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.199203 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28237091-d10c-4ee3-ac56-51f45d804024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.199872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28237091-d10c-4ee3-ac56-51f45d804024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.201516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28237091-d10c-4ee3-ac56-51f45d804024 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.211805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1256/2474] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:15:18.215792 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6fad7-b6ae-44e6-8aa1-023ec2524933 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.226162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6fad7-b6ae-44e6-8aa1-023ec2524933 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.231672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863e39-b415-46af-8efb-4742e468a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.232274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863e39-b415-46af-8efb-4742e468a260 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.232537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863e39-b415-46af-8efb-4742e468a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.232862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863e39-b415-46af-8efb-4742e468a260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.233489 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67863e39-b415-46af-8efb-4742e468a260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.235172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67863e39-b415-46af-8efb-4742e468a260 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.245840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1219/2475] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:15:18.250005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237091-d10c-4ee3-ac56-51f45d804024 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.260328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28237091-d10c-4ee3-ac56-51f45d804024 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.265125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c712c5-a4a6-4cf4-a620-2b76c215a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.265770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c712c5-a4a6-4cf4-a620-2b76c215a86f admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.266046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c712c5-a4a6-4cf4-a620-2b76c215a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.266320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c712c5-a4a6-4cf4-a620-2b76c215a86f admin admin] PATH_INFO: `/v3/projects/d70532ab07e4431cbe2f21e9346aaa63/users/c8ed8e24ba7d49579b682a069d7761bb/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.280908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c712c5-a4a6-4cf4-a620-2b76c215a86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70532ab07e4431cbe2f21e9346aaa63, user_id=c8ed8e24ba7d49579b682a069d7761bb, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.283720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c712c5-a4a6-4cf4-a620-2b76c215a86f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.298648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1257/2476] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:15:18 2022] PUT /identity/v3/projects/d70532ab07e4431cbe2f21e9346aaa63/users/c8ed8e24ba7d49579b682a069d7761bb/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:18.309491 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c8d53-fd7f-4f19-8750-1b9ee1acd873 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.309780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c8d53-fd7f-4f19-8750-1b9ee1acd873 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.310079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c8d53-fd7f-4f19-8750-1b9ee1acd873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.339302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-267c8d53-fd7f-4f19-8750-1b9ee1acd873 None None] MFA Rules not processed for user `c8ed8e24ba7d49579b682a069d7761bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:18.340564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-267c8d53-fd7f-4f19-8750-1b9ee1acd873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:18.371344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:18.411207 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1220/2477] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:18.415998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c712c5-a4a6-4cf4-a620-2b76c215a86f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.476595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c712c5-a4a6-4cf4-a620-2b76c215a86f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.481725 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1250-961b-4e37-a460-67c04679118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.482333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1250-961b-4e37-a460-67c04679118a admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.482613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1250-961b-4e37-a460-67c04679118a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.482950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1250-961b-4e37-a460-67c04679118a admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.483510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec1250-961b-4e37-a460-67c04679118a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.485620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec1250-961b-4e37-a460-67c04679118a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.519953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1258/2478] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:15:18 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:15:18.524381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c8d53-fd7f-4f19-8750-1b9ee1acd873 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.537869 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c8d53-fd7f-4f19-8750-1b9ee1acd873 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.602937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca34a6-20b0-44f1-8aef-4e7c64778a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.603582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca34a6-20b0-44f1-8aef-4e7c64778a85 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.603864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca34a6-20b0-44f1-8aef-4e7c64778a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.604172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca34a6-20b0-44f1-8aef-4e7c64778a85 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.604801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca34a6-20b0-44f1-8aef-4e7c64778a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.606804 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca34a6-20b0-44f1-8aef-4e7c64778a85 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.630113 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1221/2479] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:15:18 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:15:18.634181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1250-961b-4e37-a460-67c04679118a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.645409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1250-961b-4e37-a460-67c04679118a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.650974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5069f-aba9-4832-bed8-76ae9acd2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.651612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5069f-aba9-4832-bed8-76ae9acd2ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.651890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5069f-aba9-4832-bed8-76ae9acd2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.652160 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5069f-aba9-4832-bed8-76ae9acd2ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.652804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5069f-aba9-4832-bed8-76ae9acd2ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.654442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5069f-aba9-4832-bed8-76ae9acd2ac9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.665585 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1259/2480] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:15:18.669914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca34a6-20b0-44f1-8aef-4e7c64778a85 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.680822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca34a6-20b0-44f1-8aef-4e7c64778a85 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.686657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5c41-b4c1-4982-be3d-c8b12046680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.687314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5c41-b4c1-4982-be3d-c8b12046680a admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.687595 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5c41-b4c1-4982-be3d-c8b12046680a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.687866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5c41-b4c1-4982-be3d-c8b12046680a admin admin] PATH_INFO: `/v3/projects/d0154cbcda87448b99e2fddb8deab38f/users/84fb01e9da6342bdb208462e8a168f4b/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.703793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a5c41-b4c1-4982-be3d-c8b12046680a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0154cbcda87448b99e2fddb8deab38f, user_id=84fb01e9da6342bdb208462e8a168f4b, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.706551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a5c41-b4c1-4982-be3d-c8b12046680a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.721669 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1222/2481] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:15:18 2022] PUT /identity/v3/projects/d0154cbcda87448b99e2fddb8deab38f/users/84fb01e9da6342bdb208462e8a168f4b/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:15:18.725783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5069f-aba9-4832-bed8-76ae9acd2ac9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.736079 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5069f-aba9-4832-bed8-76ae9acd2ac9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.767172 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:18.795743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b598b53-154d-4b0f-9135-c4e30365a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.796356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598b53-154d-4b0f-9135-c4e30365a886 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.796639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598b53-154d-4b0f-9135-c4e30365a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.796916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b598b53-154d-4b0f-9135-c4e30365a886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.797599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b598b53-154d-4b0f-9135-c4e30365a886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.799212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b598b53-154d-4b0f-9135-c4e30365a886 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.810189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1260/2482] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:15:18.816719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5c41-b4c1-4982-be3d-c8b12046680a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.832688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5c41-b4c1-4982-be3d-c8b12046680a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:18.838696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c564a9d-ea29-408b-9234-b2bc1754df3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:18.839342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c564a9d-ea29-408b-9234-b2bc1754df3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.839616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c564a9d-ea29-408b-9234-b2bc1754df3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.839882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c564a9d-ea29-408b-9234-b2bc1754df3d admin admin] PATH_INFO: `/v3/projects/d0154cbcda87448b99e2fddb8deab38f/users/84fb01e9da6342bdb208462e8a168f4b/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.842120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c564a9d-ea29-408b-9234-b2bc1754df3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0154cbcda87448b99e2fddb8deab38f, user_id=84fb01e9da6342bdb208462e8a168f4b, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:18.844760 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c564a9d-ea29-408b-9234-b2bc1754df3d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:18.856321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1223/2483] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:15:18 2022] PUT /identity/v3/projects/d0154cbcda87448b99e2fddb8deab38f/users/84fb01e9da6342bdb208462e8a168f4b/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:18.867935 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8ca7-c11b-42b7-871d-8f3615c1763e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:18.868231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8ca7-c11b-42b7-871d-8f3615c1763e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:18.868508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8ca7-c11b-42b7-871d-8f3615c1763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:18.898708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-b0cc8ca7-c11b-42b7-871d-8f3615c1763e None None] MFA Rules not processed for user `84fb01e9da6342bdb208462e8a168f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:18.899949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-b0cc8ca7-c11b-42b7-871d-8f3615c1763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:18.979113 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1261/2484] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:18.991470 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c564a9d-ea29-408b-9234-b2bc1754df3d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:18.993275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2c564a9d-ea29-408b-9234-b2bc1754df3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:19.052588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c564a9d-ea29-408b-9234-b2bc1754df3d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:19.057278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd6a72-2dbc-4ef2-b57a-30c39dea0dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:19.057922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd6a72-2dbc-4ef2-b57a-30c39dea0dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:19.058200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd6a72-2dbc-4ef2-b57a-30c39dea0dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:19.058467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd6a72-2dbc-4ef2-b57a-30c39dea0dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:19.068536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd6a72-2dbc-4ef2-b57a-30c39dea0dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:19.070076 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd6a72-2dbc-4ef2-b57a-30c39dea0dc1 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:19.079756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1224/2485] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:19.167900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc8ca7-c11b-42b7-871d-8f3615c1763e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:19.178475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc8ca7-c11b-42b7-871d-8f3615c1763e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:19.182108 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f22609-66a0-49f4-baa9-745f07bf22f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:19.182716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f22609-66a0-49f4-baa9-745f07bf22f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:19.182996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f22609-66a0-49f4-baa9-745f07bf22f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:19.183267 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f22609-66a0-49f4-baa9-745f07bf22f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:19.245765 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f22609-66a0-49f4-baa9-745f07bf22f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:19.247332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f22609-66a0-49f4-baa9-745f07bf22f0 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:19.257558 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1262/2486] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:19.435558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd6a72-2dbc-4ef2-b57a-30c39dea0dc1 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:19.437227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bccd6a72-2dbc-4ef2-b57a-30c39dea0dc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:19.482957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:19.527297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd6a72-2dbc-4ef2-b57a-30c39dea0dc1 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:19.532931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a14d2-0edc-4f39-be4c-e8c06dcd4ba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4716f9539151414dadd9e4b8f13ffc0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:19.533585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a14d2-0edc-4f39-be4c-e8c06dcd4ba2 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:19.533864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a14d2-0edc-4f39-be4c-e8c06dcd4ba2 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:19.534134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a14d2-0edc-4f39-be4c-e8c06dcd4ba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:19.536043 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-740a14d2-0edc-4f39-be4c-e8c06dcd4ba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:19.548196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a14d2-0edc-4f39-be4c-e8c06dcd4ba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:19.549839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a14d2-0edc-4f39-be4c-e8c06dcd4ba2 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:19.560661 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1225/2487] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:21.999950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f22609-66a0-49f4-baa9-745f07bf22f0 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:22.001958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d3f22609-66a0-49f4-baa9-745f07bf22f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:22.056616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:22.079526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f22609-66a0-49f4-baa9-745f07bf22f0 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:22.086635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d65271-8e21-4514-93ce-aec753cc10e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:22.087391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65271-8e21-4514-93ce-aec753cc10e1 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:22.087737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65271-8e21-4514-93ce-aec753cc10e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:22.088059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65271-8e21-4514-93ce-aec753cc10e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:22.090171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-74d65271-8e21-4514-93ce-aec753cc10e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:22.156157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d65271-8e21-4514-93ce-aec753cc10e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:22.157972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d65271-8e21-4514-93ce-aec753cc10e1 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:22.167435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1263/2488] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:29.555976 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=21 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:32.163160 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=32 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:37.101871 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a14d2-0edc-4f39-be4c-e8c06dcd4ba2 service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:37.115324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a14d2-0edc-4f39-be4c-e8c06dcd4ba2 service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:37.122970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292531d-cb0d-4c44-9858-b7482e1636f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:37.123927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292531d-cb0d-4c44-9858-b7482e1636f7 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:37.123927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292531d-cb0d-4c44-9858-b7482e1636f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:37.124219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292531d-cb0d-4c44-9858-b7482e1636f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:37.126831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3292531d-cb0d-4c44-9858-b7482e1636f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:37.141670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292531d-cb0d-4c44-9858-b7482e1636f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:37.143338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292531d-cb0d-4c44-9858-b7482e1636f7 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:37.156622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1226/2489] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:39.709139 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abae48-9f01-45ea-8f8d-808b22e4255e None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:39.709619 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abae48-9f01-45ea-8f8d-808b22e4255e None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:39.709713 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abae48-9f01-45ea-8f8d-808b22e4255e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:39.733003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-18abae48-9f01-45ea-8f8d-808b22e4255e None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:39.734252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-18abae48-9f01-45ea-8f8d-808b22e4255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:39.800735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1264/2490] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:15:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:39.814239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292531d-cb0d-4c44-9858-b7482e1636f7 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:39.815712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3292531d-cb0d-4c44-9858-b7482e1636f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:39.889477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292531d-cb0d-4c44-9858-b7482e1636f7 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:39.894638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef66769-f7b5-4f00-a254-9cc62a5af05c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:39.895286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef66769-f7b5-4f00-a254-9cc62a5af05c service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:39.895546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef66769-f7b5-4f00-a254-9cc62a5af05c service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:39.895811 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef66769-f7b5-4f00-a254-9cc62a5af05c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:39.904318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef66769-f7b5-4f00-a254-9cc62a5af05c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:39.905959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef66769-f7b5-4f00-a254-9cc62a5af05c service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:39.914304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1227/2491] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:15:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:15:42.980360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abae48-9f01-45ea-8f8d-808b22e4255e None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:42.982671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-18abae48-9f01-45ea-8f8d-808b22e4255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:43.057288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abae48-9f01-45ea-8f8d-808b22e4255e None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:43.060980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160ea97-5fe4-4d80-b69b-796d52a8448b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:43.061656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160ea97-5fe4-4d80-b69b-796d52a8448b service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:43.061935 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160ea97-5fe4-4d80-b69b-796d52a8448b service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:43.062209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160ea97-5fe4-4d80-b69b-796d52a8448b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:43.064014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a160ea97-5fe4-4d80-b69b-796d52a8448b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:43.136450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160ea97-5fe4-4d80-b69b-796d52a8448b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:43.136450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160ea97-5fe4-4d80-b69b-796d52a8448b service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:43.147238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1265/2492] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:47.246537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef66769-f7b5-4f00-a254-9cc62a5af05c service swift] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:47.248777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bef66769-f7b5-4f00-a254-9cc62a5af05c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:47.270342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef66769-f7b5-4f00-a254-9cc62a5af05c service swift] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:47.276647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c76fb-99a7-40ce-8666-9773f4bb09d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4716f9539151414dadd9e4b8f13ffc0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:47.277803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c76fb-99a7-40ce-8666-9773f4bb09d4 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:47.278291 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c76fb-99a7-40ce-8666-9773f4bb09d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:47.278881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c76fb-99a7-40ce-8666-9773f4bb09d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:47.280937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8b7c76fb-99a7-40ce-8666-9773f4bb09d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:47.296935 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c76fb-99a7-40ce-8666-9773f4bb09d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:47.304269 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c76fb-99a7-40ce-8666-9773f4bb09d4 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:47.332422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1228/2493] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:47.409941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160ea97-5fe4-4d80-b69b-796d52a8448b service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:47.411825 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a160ea97-5fe4-4d80-b69b-796d52a8448b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:47.435273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160ea97-5fe4-4d80-b69b-796d52a8448b service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:47.441069 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:47.441710 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:47.441996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:47.442439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] PATH_INFO: `/v3/users/58005342342744a98bbfe8ed97ad151b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:47.443589 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58005342342744a98bbfe8ed97ad151b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:47.446086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:47.524743 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58005342342744a98bbfe8ed97ad151b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:47.525507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58005342342744a98bbfe8ed97ad151b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:47.528006 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:47.546605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58005342342744a98bbfe8ed97ad151b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:47.557122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58005342342744a98bbfe8ed97ad151b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:47.557878 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-61ad2354-b929-42b9-964d-a9988c37d3c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58005342342744a98bbfe8ed97ad151b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:47.577535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1266/2494] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:15:47 2022] DELETE /identity/v3/users/58005342342744a98bbfe8ed97ad151b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:47.804643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c76fb-99a7-40ce-8666-9773f4bb09d4 service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:47.817440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c76fb-99a7-40ce-8666-9773f4bb09d4 service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:47.887758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:47.888413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:47.888692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:47.888964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] PATH_INFO: `/v3/projects/4a45f62732c04e2ca257d4f9904c04d8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:47.890165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a45f62732c04e2ca257d4f9904c04d8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:47.892165 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:47.945081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a45f62732c04e2ca257d4f9904c04d8', 'request_id': 'req-5b95add4-0303-4b35-9b81-2d50a6c50d3a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:47.951250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a45f62732c04e2ca257d4f9904c04d8', 'request_id': 'req-5b95add4-0303-4b35-9b81-2d50a6c50d3a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:47.961618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a45f62732c04e2ca257d4f9904c04d8', 'request_id': 'req-5b95add4-0303-4b35-9b81-2d50a6c50d3a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:47.964628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:47.976444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] The token cache is being invalidate because project 4a45f62732c04e2ca257d4f9904c04d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:15:47.976745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:47.977770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5b95add4-0303-4b35-9b81-2d50a6c50d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:47.979453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1229/2495] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:15:47 2022] DELETE /identity/v3/projects/4a45f62732c04e2ca257d4f9904c04d8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:47.984456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38835-5772-4ac7-bfff-4e0f44eee9f5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:47.984747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38835-5772-4ac7-bfff-4e0f44eee9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:47.985051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38835-5772-4ac7-bfff-4e0f44eee9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:48.008483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-30f38835-5772-4ac7-bfff-4e0f44eee9f5 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:48.009987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-30f38835-5772-4ac7-bfff-4e0f44eee9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:48.071761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1267/2496] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:48.080004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc370f99-6e31-4f92-a2b3-305e19ef843b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:48.080516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc370f99-6e31-4f92-a2b3-305e19ef843b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:48.080888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc370f99-6e31-4f92-a2b3-305e19ef843b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:48.102571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dc370f99-6e31-4f92-a2b3-305e19ef843b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:48.103839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dc370f99-6e31-4f92-a2b3-305e19ef843b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:48.116471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38835-5772-4ac7-bfff-4e0f44eee9f5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:48.117012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1230/2497] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:15:48.126872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38835-5772-4ac7-bfff-4e0f44eee9f5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:48.138007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b90699-e879-4ec9-beed-e454e18904fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:48.138650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b90699-e879-4ec9-beed-e454e18904fa admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:48.138925 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b90699-e879-4ec9-beed-e454e18904fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:48.139195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b90699-e879-4ec9-beed-e454e18904fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:48.139859 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b90699-e879-4ec9-beed-e454e18904fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:15:48.140161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b90699-e879-4ec9-beed-e454e18904fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:48.141836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b90699-e879-4ec9-beed-e454e18904fa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:48.158539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1268/2498] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:15:48.162816 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc370f99-6e31-4f92-a2b3-305e19ef843b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:48.173954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc370f99-6e31-4f92-a2b3-305e19ef843b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:48.179492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0bc8a-a03d-436c-9221-dde27d3b8040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:48.180183 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0bc8a-a03d-436c-9221-dde27d3b8040 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:48.191783 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0bc8a-a03d-436c-9221-dde27d3b8040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:48.192134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0bc8a-a03d-436c-9221-dde27d3b8040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:48.192838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0bc8a-a03d-436c-9221-dde27d3b8040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:48.194808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0bc8a-a03d-436c-9221-dde27d3b8040 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:48.246429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1231/2499] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:15:48 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:15:48.251610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b90699-e879-4ec9-beed-e454e18904fa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:48.262814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b90699-e879-4ec9-beed-e454e18904fa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:48.335129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190ac0-9179-4aee-8d26-14547aea2b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:48.335771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190ac0-9179-4aee-8d26-14547aea2b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:48.336054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190ac0-9179-4aee-8d26-14547aea2b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:48.336330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b190ac0-9179-4aee-8d26-14547aea2b2b admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:48.337016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b190ac0-9179-4aee-8d26-14547aea2b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:48.339026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b190ac0-9179-4aee-8d26-14547aea2b2b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:48.363823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1269/2500] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:15:48 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:15:48.367680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0bc8a-a03d-436c-9221-dde27d3b8040 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:48.380989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0bc8a-a03d-436c-9221-dde27d3b8040 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:48.386774 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c346e-a827-46f5-aac0-1fd4f1441ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:48.387432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c346e-a827-46f5-aac0-1fd4f1441ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:48.387708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c346e-a827-46f5-aac0-1fd4f1441ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:48.387974 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c346e-a827-46f5-aac0-1fd4f1441ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:48.388619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c346e-a827-46f5-aac0-1fd4f1441ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:48.390302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c346e-a827-46f5-aac0-1fd4f1441ee9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:48.404314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1232/2501] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:15:48.409489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190ac0-9179-4aee-8d26-14547aea2b2b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:48.426658 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b190ac0-9179-4aee-8d26-14547aea2b2b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:48.433419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590cd06-f70e-468e-8997-f850e82a7a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:48.434129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590cd06-f70e-468e-8997-f850e82a7a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:48.434672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590cd06-f70e-468e-8997-f850e82a7a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:48.435025 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590cd06-f70e-468e-8997-f850e82a7a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:48.435756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590cd06-f70e-468e-8997-f850e82a7a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:48.437499 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590cd06-f70e-468e-8997-f850e82a7a91 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:48.450593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1270/2502] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:15:48.454853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c346e-a827-46f5-aac0-1fd4f1441ee9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:48.469317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c346e-a827-46f5-aac0-1fd4f1441ee9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:48.481393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f82f4-49e0-42cd-b8a9-6c41e410de00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:48.482827 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f82f4-49e0-42cd-b8a9-6c41e410de00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:48.483720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f82f4-49e0-42cd-b8a9-6c41e410de00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:48.484093 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f82f4-49e0-42cd-b8a9-6c41e410de00 admin admin] PATH_INFO: `/v3/projects/50ae0a701af74c578f92ec213d6909d2/users/d2cd08c0e3194e4cbb60925fa1332ab2/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:48.503598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f82f4-49e0-42cd-b8a9-6c41e410de00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ae0a701af74c578f92ec213d6909d2, user_id=d2cd08c0e3194e4cbb60925fa1332ab2, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:48.507849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f82f4-49e0-42cd-b8a9-6c41e410de00 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:48.528656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1233/2503] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:15:48 2022] PUT /identity/v3/projects/50ae0a701af74c578f92ec213d6909d2/users/d2cd08c0e3194e4cbb60925fa1332ab2/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:15:48.530938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f27b5-fce3-4deb-846c-7886ec2d7a2f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:48.531235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f27b5-fce3-4deb-846c-7886ec2d7a2f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:48.531531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f27b5-fce3-4deb-846c-7886ec2d7a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:48.565232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d27f27b5-fce3-4deb-846c-7886ec2d7a2f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:48.565232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d27f27b5-fce3-4deb-846c-7886ec2d7a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:48.597271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:48.638134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1271/2504] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:48.650725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f82f4-49e0-42cd-b8a9-6c41e410de00 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:48.652763 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-993f82f4-49e0-42cd-b8a9-6c41e410de00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:48.720327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f82f4-49e0-42cd-b8a9-6c41e410de00 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:48.725070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efdcbb-a0c8-4b72-8c86-79040b57bc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:48.726411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdcbb-a0c8-4b72-8c86-79040b57bc41 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:48.726411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdcbb-a0c8-4b72-8c86-79040b57bc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:48.726411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efdcbb-a0c8-4b72-8c86-79040b57bc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:48.742424 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efdcbb-a0c8-4b72-8c86-79040b57bc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:48.743863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efdcbb-a0c8-4b72-8c86-79040b57bc41 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:48.755733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1234/2505] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:15:50.172965 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f27b5-fce3-4deb-846c-7886ec2d7a2f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:50.174460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d27f27b5-fce3-4deb-846c-7886ec2d7a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:50.188889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f27b5-fce3-4deb-846c-7886ec2d7a2f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:50.203471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:50.204624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:50.205199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:50.205641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] PATH_INFO: `/v3/users/c8ed8e24ba7d49579b682a069d7761bb` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:50.207581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ed8e24ba7d49579b682a069d7761bb)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:50.210522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:50.301818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ed8e24ba7d49579b682a069d7761bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:50.303836 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ed8e24ba7d49579b682a069d7761bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:50.328605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ed8e24ba7d49579b682a069d7761bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:50.344698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ed8e24ba7d49579b682a069d7761bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:50.345715 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ed8e24ba7d49579b682a069d7761bb'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:50.366705 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1272/2506] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:15:50 2022] DELETE /identity/v3/users/c8ed8e24ba7d49579b682a069d7761bb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:50.372630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b2ede-b6cf-4a7c-8235-ca1d13b49b31 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:50.373156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b2ede-b6cf-4a7c-8235-ca1d13b49b31 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:50.373268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b2ede-b6cf-4a7c-8235-ca1d13b49b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:50.413853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0f5b2ede-b6cf-4a7c-8235-ca1d13b49b31 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:50.415597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0f5b2ede-b6cf-4a7c-8235-ca1d13b49b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:50.517066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1235/2507] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:50.527213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:50.528683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:50.640010 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92e2d9-f3f4-4bf0-a919-6ef244a0b0d4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:50.645642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417841b-85e6-4df8-ab77-f6253b7456ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:50.646516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417841b-85e6-4df8-ab77-f6253b7456ce service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:50.646816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417841b-85e6-4df8-ab77-f6253b7456ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:50.647132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417841b-85e6-4df8-ab77-f6253b7456ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:50.663916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417841b-85e6-4df8-ab77-f6253b7456ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:50.666235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417841b-85e6-4df8-ab77-f6253b7456ce service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:50.678639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1273/2508] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:51.061249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b2ede-b6cf-4a7c-8235-ca1d13b49b31 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:51.062837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0f5b2ede-b6cf-4a7c-8235-ca1d13b49b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:51.078194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b2ede-b6cf-4a7c-8235-ca1d13b49b31 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:51.083616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:51.084275 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:51.084724 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:51.084979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] PATH_INFO: `/v3/projects/d70532ab07e4431cbe2f21e9346aaa63` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:51.087685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70532ab07e4431cbe2f21e9346aaa63)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:51.089571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:51.123443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:51.144310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70532ab07e4431cbe2f21e9346aaa63', 'request_id': 'req-a641905d-3295-4f68-b2b1-fbfe0dd7e481'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:51.156037 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70532ab07e4431cbe2f21e9346aaa63', 'request_id': 'req-a641905d-3295-4f68-b2b1-fbfe0dd7e481'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:51.166833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70532ab07e4431cbe2f21e9346aaa63', 'request_id': 'req-a641905d-3295-4f68-b2b1-fbfe0dd7e481'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:51.178950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] The token cache is being invalidate because project d70532ab07e4431cbe2f21e9346aaa63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:15:51.179238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:51.179885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:51.181462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1236/2509] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:15:51 2022] DELETE /identity/v3/projects/d70532ab07e4431cbe2f21e9346aaa63 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:51.185548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417841b-85e6-4df8-ab77-f6253b7456ce service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:51.195946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417841b-85e6-4df8-ab77-f6253b7456ce service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:51.258554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:51.272958 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:51.274090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:51.274762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:51.275744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] PATH_INFO: `/v3/users/84fb01e9da6342bdb208462e8a168f4b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:51.277383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84fb01e9da6342bdb208462e8a168f4b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:51.279756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:51.363502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84fb01e9da6342bdb208462e8a168f4b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:51.364294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84fb01e9da6342bdb208462e8a168f4b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:51.390454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84fb01e9da6342bdb208462e8a168f4b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:51.408954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84fb01e9da6342bdb208462e8a168f4b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:51.409912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84fb01e9da6342bdb208462e8a168f4b'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:51.410058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:51.411740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:51.438987 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1274/2510] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:15:51 2022] DELETE /identity/v3/users/84fb01e9da6342bdb208462e8a168f4b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:51.506778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641905d-3295-4f68-b2b1-fbfe0dd7e481 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:51.630892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff6158-024b-4deb-ba08-c4d389d81d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:51.631668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff6158-024b-4deb-ba08-c4d389d81d99 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:51.632775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff6158-024b-4deb-ba08-c4d389d81d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:51.632916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff6158-024b-4deb-ba08-c4d389d81d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:51.641593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3aff6158-024b-4deb-ba08-c4d389d81d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:51.658080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff6158-024b-4deb-ba08-c4d389d81d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:51.667574 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff6158-024b-4deb-ba08-c4d389d81d99 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:51.679636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1237/2511] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:52.012405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:52.013916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:52.130760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc353c-8e61-4b30-9a4a-cd5a7cc7314b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:52.157012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:52.157771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:52.158057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:52.158331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] PATH_INFO: `/v3/projects/d0154cbcda87448b99e2fddb8deab38f` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:52.159936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0154cbcda87448b99e2fddb8deab38f)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:52.161972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:52.261794 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0154cbcda87448b99e2fddb8deab38f', 'request_id': 'req-d07035a3-a288-4f55-bc10-43ad2cabf397'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:52.278679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0154cbcda87448b99e2fddb8deab38f', 'request_id': 'req-d07035a3-a288-4f55-bc10-43ad2cabf397'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:52.299339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0154cbcda87448b99e2fddb8deab38f', 'request_id': 'req-d07035a3-a288-4f55-bc10-43ad2cabf397'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:52.310339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:52.320931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] The token cache is being invalidate because project d0154cbcda87448b99e2fddb8deab38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:15:52.321322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:52.325123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d07035a3-a288-4f55-bc10-43ad2cabf397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:15:52.327309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1275/2512] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:15:52 2022] DELETE /identity/v3/projects/d0154cbcda87448b99e2fddb8deab38f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:52.331994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038092ab-a49f-4cf4-8abb-988f7d02dfac None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:52.332901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038092ab-a49f-4cf4-8abb-988f7d02dfac None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:52.332901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038092ab-a49f-4cf4-8abb-988f7d02dfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:52.354202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-038092ab-a49f-4cf4-8abb-988f7d02dfac None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:52.355353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-038092ab-a49f-4cf4-8abb-988f7d02dfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:52.457301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1238/2513] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:52.460489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03169503-76de-4e9c-9f45-c71e25462f2b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:52.460775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03169503-76de-4e9c-9f45-c71e25462f2b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:52.461064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03169503-76de-4e9c-9f45-c71e25462f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:52.489389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-03169503-76de-4e9c-9f45-c71e25462f2b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:52.491110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-03169503-76de-4e9c-9f45-c71e25462f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:52.500798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1276/2514] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:15:52.505061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038092ab-a49f-4cf4-8abb-988f7d02dfac None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:52.519802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038092ab-a49f-4cf4-8abb-988f7d02dfac None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:52.524679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab44a1-c2ac-4ed4-ac8b-1de6adf67d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:52.525568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab44a1-c2ac-4ed4-ac8b-1de6adf67d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:52.525852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab44a1-c2ac-4ed4-ac8b-1de6adf67d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:52.526123 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab44a1-c2ac-4ed4-ac8b-1de6adf67d4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:52.526781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab44a1-c2ac-4ed4-ac8b-1de6adf67d4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:15:52.527260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab44a1-c2ac-4ed4-ac8b-1de6adf67d4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:52.528873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab44a1-c2ac-4ed4-ac8b-1de6adf67d4f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:52.545120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1239/2515] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:15:52.546120 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03169503-76de-4e9c-9f45-c71e25462f2b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:52.555885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03169503-76de-4e9c-9f45-c71e25462f2b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:52.561738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206da8-1d3f-4016-883f-5a143c03d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:52.562352 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206da8-1d3f-4016-883f-5a143c03d1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:52.562637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206da8-1d3f-4016-883f-5a143c03d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:52.562911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206da8-1d3f-4016-883f-5a143c03d1f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:52.563570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48206da8-1d3f-4016-883f-5a143c03d1f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:52.565537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48206da8-1d3f-4016-883f-5a143c03d1f9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:52.601388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1277/2516] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:15:52 2022] POST /identity/v3/projects => generated 355 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:15:52.602800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab44a1-c2ac-4ed4-ac8b-1de6adf67d4f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:52.610324 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:52.616344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab44a1-c2ac-4ed4-ac8b-1de6adf67d4f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:52.685300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b077ae2-f8e3-496f-b116-8eb448130c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:52.686205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b077ae2-f8e3-496f-b116-8eb448130c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:52.686482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b077ae2-f8e3-496f-b116-8eb448130c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:52.686752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b077ae2-f8e3-496f-b116-8eb448130c8e admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:52.687411 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b077ae2-f8e3-496f-b116-8eb448130c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:52.689394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b077ae2-f8e3-496f-b116-8eb448130c8e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:52.720607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1240/2517] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:15:52 2022] POST /identity/v3/users => generated 278 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:15:52.721953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206da8-1d3f-4016-883f-5a143c03d1f9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:52.732612 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206da8-1d3f-4016-883f-5a143c03d1f9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:52.737453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d385c-f217-4d8e-a809-e696a75359ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:52.738165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d385c-f217-4d8e-a809-e696a75359ca admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:52.738570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d385c-f217-4d8e-a809-e696a75359ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:52.738933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d385c-f217-4d8e-a809-e696a75359ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:52.739788 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d385c-f217-4d8e-a809-e696a75359ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:52.741522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d385c-f217-4d8e-a809-e696a75359ca admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:52.755501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1278/2518] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:15:52.757069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b077ae2-f8e3-496f-b116-8eb448130c8e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:52.767621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b077ae2-f8e3-496f-b116-8eb448130c8e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:52.773462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477907c3-3c9a-4476-82c1-46da8ad0203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:52.774868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477907c3-3c9a-4476-82c1-46da8ad0203f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:52.775350 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477907c3-3c9a-4476-82c1-46da8ad0203f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:52.775893 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477907c3-3c9a-4476-82c1-46da8ad0203f admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:52.777020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477907c3-3c9a-4476-82c1-46da8ad0203f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:52.778821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477907c3-3c9a-4476-82c1-46da8ad0203f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:52.801059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1241/2519] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:15:52.801639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d385c-f217-4d8e-a809-e696a75359ca admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:52.812830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d385c-f217-4d8e-a809-e696a75359ca admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:52.817881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82db30f-ec92-4de7-952d-85eefba05050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:52.818689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82db30f-ec92-4de7-952d-85eefba05050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:52.818975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82db30f-ec92-4de7-952d-85eefba05050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:52.819248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82db30f-ec92-4de7-952d-85eefba05050 admin admin] PATH_INFO: `/v3/projects/6241d77c531c4cff9d15879cfa9cd8d3/users/09efc78e2d7b4d098aa347834303f5dd/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:52.837603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82db30f-ec92-4de7-952d-85eefba05050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6241d77c531c4cff9d15879cfa9cd8d3, user_id=09efc78e2d7b4d098aa347834303f5dd, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:52.840337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82db30f-ec92-4de7-952d-85eefba05050 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:52.869175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1279/2520] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:15:52 2022] PUT /identity/v3/projects/6241d77c531c4cff9d15879cfa9cd8d3/users/09efc78e2d7b4d098aa347834303f5dd/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:52.878065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dede3d-2d9f-406d-b5a4-ab27234d61d0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:52.878443 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dede3d-2d9f-406d-b5a4-ab27234d61d0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:52.878822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dede3d-2d9f-406d-b5a4-ab27234d61d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:52.913629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-98dede3d-2d9f-406d-b5a4-ab27234d61d0 None None] MFA Rules not processed for user `09efc78e2d7b4d098aa347834303f5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:52.915762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-98dede3d-2d9f-406d-b5a4-ab27234d61d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:53.004148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1242/2521] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:53.008235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82db30f-ec92-4de7-952d-85eefba05050 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:53.117254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82db30f-ec92-4de7-952d-85eefba05050 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:53.123526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd5fce-ec77-4dda-81e5-a621ce5c3022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:53.124463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd5fce-ec77-4dda-81e5-a621ce5c3022 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:53.124812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd5fce-ec77-4dda-81e5-a621ce5c3022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:53.125316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd5fce-ec77-4dda-81e5-a621ce5c3022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:53.126334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd5fce-ec77-4dda-81e5-a621ce5c3022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:53.129413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd5fce-ec77-4dda-81e5-a621ce5c3022 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:53.167770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1280/2522] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:15:53 2022] POST /identity/v3/projects => generated 357 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:15:53.171953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dede3d-2d9f-406d-b5a4-ab27234d61d0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:53.189807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dede3d-2d9f-406d-b5a4-ab27234d61d0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:53.317062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c1104-bf61-4e16-a486-6be4b15e4c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:53.317062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1104-bf61-4e16-a486-6be4b15e4c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:53.317062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1104-bf61-4e16-a486-6be4b15e4c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:53.317062 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c1104-bf61-4e16-a486-6be4b15e4c59 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:53.317550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c1104-bf61-4e16-a486-6be4b15e4c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:53.317550 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c1104-bf61-4e16-a486-6be4b15e4c59 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:53.343208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:53.353389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1243/2523] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:15:53 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:15:53.355187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd5fce-ec77-4dda-81e5-a621ce5c3022 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:53.368960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd5fce-ec77-4dda-81e5-a621ce5c3022 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:53.374124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7e904-7003-41de-bcc6-67b9961f5681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:53.375070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7e904-7003-41de-bcc6-67b9961f5681 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:53.375853 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7e904-7003-41de-bcc6-67b9961f5681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:53.376331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7e904-7003-41de-bcc6-67b9961f5681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:53.377145 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7e904-7003-41de-bcc6-67b9961f5681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:53.379095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7e904-7003-41de-bcc6-67b9961f5681 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:53.391970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1281/2524] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:15:53.396487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c1104-bf61-4e16-a486-6be4b15e4c59 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:53.413910 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c1104-bf61-4e16-a486-6be4b15e4c59 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:53.426065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4850b-190c-4fa5-a543-529fcb4d9957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:53.427028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4850b-190c-4fa5-a543-529fcb4d9957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:53.427312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4850b-190c-4fa5-a543-529fcb4d9957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:53.427585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4850b-190c-4fa5-a543-529fcb4d9957 admin admin] PATH_INFO: `/v3/projects/73f7a73c50664803aadb53a5f076e79f/users/915190954f804f2e89ceff5792dc3eed/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:53.451912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4850b-190c-4fa5-a543-529fcb4d9957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f7a73c50664803aadb53a5f076e79f, user_id=915190954f804f2e89ceff5792dc3eed, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:53.455711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4850b-190c-4fa5-a543-529fcb4d9957 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:53.476281 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1244/2525] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:15:53 2022] PUT /identity/v3/projects/73f7a73c50664803aadb53a5f076e79f/users/915190954f804f2e89ceff5792dc3eed/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:53.478579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7e904-7003-41de-bcc6-67b9961f5681 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:53.490288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7e904-7003-41de-bcc6-67b9961f5681 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:53.568096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba3839-070b-4e1e-b895-6358f34f0af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:53.568905 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3839-070b-4e1e-b895-6358f34f0af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:53.569302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3839-070b-4e1e-b895-6358f34f0af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:53.569666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba3839-070b-4e1e-b895-6358f34f0af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:53.570404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba3839-070b-4e1e-b895-6358f34f0af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:53.572305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba3839-070b-4e1e-b895-6358f34f0af1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:53.583912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1282/2526] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:15:53.587651 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4850b-190c-4fa5-a543-529fcb4d9957 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:53.598911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4850b-190c-4fa5-a543-529fcb4d9957 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:53.603756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eb46d-b033-4973-b6bc-29eac67415b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:53.604440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb46d-b033-4973-b6bc-29eac67415b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:53.604717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb46d-b033-4973-b6bc-29eac67415b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:53.604991 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb46d-b033-4973-b6bc-29eac67415b2 admin admin] PATH_INFO: `/v3/projects/73f7a73c50664803aadb53a5f076e79f/users/915190954f804f2e89ceff5792dc3eed/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:53.607139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eb46d-b033-4973-b6bc-29eac67415b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f7a73c50664803aadb53a5f076e79f, user_id=915190954f804f2e89ceff5792dc3eed, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:53.609837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eb46d-b033-4973-b6bc-29eac67415b2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:53.626479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1245/2527] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:15:53 2022] PUT /identity/v3/projects/73f7a73c50664803aadb53a5f076e79f/users/915190954f804f2e89ceff5792dc3eed/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:15:53.636788 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1193e-0aed-4997-9f86-9125134e4f65 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:53.637289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1193e-0aed-4997-9f86-9125134e4f65 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:53.637580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1193e-0aed-4997-9f86-9125134e4f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:53.646673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:53.673169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-93a1193e-0aed-4997-9f86-9125134e4f65 None None] MFA Rules not processed for user `915190954f804f2e89ceff5792dc3eed`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:53.675114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-93a1193e-0aed-4997-9f86-9125134e4f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:53.750321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1283/2528] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:53.762852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eb46d-b033-4973-b6bc-29eac67415b2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:53.764712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-102eb46d-b033-4973-b6bc-29eac67415b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:53.870354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eb46d-b033-4973-b6bc-29eac67415b2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:53.874053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba427e-83a2-4f2b-b0db-a5d94477ae8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:53.874681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba427e-83a2-4f2b-b0db-a5d94477ae8a service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:53.874957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba427e-83a2-4f2b-b0db-a5d94477ae8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:53.875232 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba427e-83a2-4f2b-b0db-a5d94477ae8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:53.886323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba427e-83a2-4f2b-b0db-a5d94477ae8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:53.887794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba427e-83a2-4f2b-b0db-a5d94477ae8a service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:53.899838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1246/2529] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:54.008595 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1193e-0aed-4997-9f86-9125134e4f65 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:54.020154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1193e-0aed-4997-9f86-9125134e4f65 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:54.026195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa86ff9-1d0f-4784-85d4-d516e50dfa5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:54.027034 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86ff9-1d0f-4784-85d4-d516e50dfa5b service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:54.027359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86ff9-1d0f-4784-85d4-d516e50dfa5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:54.027723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa86ff9-1d0f-4784-85d4-d516e50dfa5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:54.132854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa86ff9-1d0f-4784-85d4-d516e50dfa5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:54.134596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa86ff9-1d0f-4784-85d4-d516e50dfa5b service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:54.159668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1284/2530] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:54.234461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ae409-ae29-4a68-a9e6-501d57d09769 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:54.234754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ae409-ae29-4a68-a9e6-501d57d09769 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:54.235003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ae409-ae29-4a68-a9e6-501d57d09769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:54.271049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d50ae409-ae29-4a68-a9e6-501d57d09769 None None] MFA Rules not processed for user `d2cd08c0e3194e4cbb60925fa1332ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:54.272276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d50ae409-ae29-4a68-a9e6-501d57d09769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:54.420279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1247/2531] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:54.427985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa86ff9-1d0f-4784-85d4-d516e50dfa5b service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:54.430775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9aa86ff9-1d0f-4784-85d4-d516e50dfa5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:54.511601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa86ff9-1d0f-4784-85d4-d516e50dfa5b service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:54.517212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454bc10-db53-460a-922b-f5dd6c6ae00b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:54.517831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454bc10-db53-460a-922b-f5dd6c6ae00b service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:54.518110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454bc10-db53-460a-922b-f5dd6c6ae00b service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:54.518378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454bc10-db53-460a-922b-f5dd6c6ae00b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:54.526728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454bc10-db53-460a-922b-f5dd6c6ae00b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:54.528327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454bc10-db53-460a-922b-f5dd6c6ae00b service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:54.537842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1285/2532] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:55.164496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ae409-ae29-4a68-a9e6-501d57d09769 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:55.167226 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d50ae409-ae29-4a68-a9e6-501d57d09769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:55.184500 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ae409-ae29-4a68-a9e6-501d57d09769 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:55.190657 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d18b1-fb9a-42a1-929c-98ec37e8dde6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:55.191284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d18b1-fb9a-42a1-929c-98ec37e8dde6 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:55.191567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d18b1-fb9a-42a1-929c-98ec37e8dde6 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:55.191898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d18b1-fb9a-42a1-929c-98ec37e8dde6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:55.195191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c04d18b1-fb9a-42a1-929c-98ec37e8dde6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:55.213584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d18b1-fb9a-42a1-929c-98ec37e8dde6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:55.215782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d18b1-fb9a-42a1-929c-98ec37e8dde6 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:55.229083 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1248/2533] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:56.021491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d3c68-9206-484e-859c-88857eb78f37 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:56.021982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d3c68-9206-484e-859c-88857eb78f37 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:56.022067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d3c68-9206-484e-859c-88857eb78f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:56.046036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2f3d3c68-9206-484e-859c-88857eb78f37 None None] MFA Rules not processed for user `d2cd08c0e3194e4cbb60925fa1332ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:56.047443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2f3d3c68-9206-484e-859c-88857eb78f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:56.055868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1286/2534] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:15:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:56.417588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d18b1-fb9a-42a1-929c-98ec37e8dde6 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:56.419217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c04d18b1-fb9a-42a1-929c-98ec37e8dde6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:56.471564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:56.484983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d18b1-fb9a-42a1-929c-98ec37e8dde6 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:56.489580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f5b69-5b97-47ba-812e-e9f84cb22166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:56.490285 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5b69-5b97-47ba-812e-e9f84cb22166 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:56.490628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5b69-5b97-47ba-812e-e9f84cb22166 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:56.490961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5b69-5b97-47ba-812e-e9f84cb22166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:56.492807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-632f5b69-5b97-47ba-812e-e9f84cb22166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:56.507342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f5b69-5b97-47ba-812e-e9f84cb22166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:56.508907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f5b69-5b97-47ba-812e-e9f84cb22166 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:56.518694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1249/2535] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:56.771485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a2da9-bd4e-47ed-b2a9-79ebde102b5a None None] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:56.771996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a2da9-bd4e-47ed-b2a9-79ebde102b5a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:56.772342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a2da9-bd4e-47ed-b2a9-79ebde102b5a None None] PATH_INFO: `/` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:56.773871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1287/2536] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:15:56.783245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68284ba1-6c27-4b65-9843-5012e05ec83a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:56.783523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68284ba1-6c27-4b65-9843-5012e05ec83a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:56.783880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68284ba1-6c27-4b65-9843-5012e05ec83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:56.821673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-68284ba1-6c27-4b65-9843-5012e05ec83a None None] MFA Rules not processed for user `ea18c782ddf2469fa3d10a135fc34c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:56.825932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-68284ba1-6c27-4b65-9843-5012e05ec83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:56.837909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1250/2537] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:15:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:15:56.851774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a2da9-bd4e-47ed-b2a9-79ebde102b5a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:56.855225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7e4a2da9-bd4e-47ed-b2a9-79ebde102b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:56.883763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:15:56.987815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a2da9-bd4e-47ed-b2a9-79ebde102b5a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:56.992529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dea224-67ca-4189-9d76-31f3187dffbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c746178628e4df5961982268e642ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:56.993356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dea224-67ca-4189-9d76-31f3187dffbf service glance] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:56.993733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dea224-67ca-4189-9d76-31f3187dffbf service glance] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:56.994102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dea224-67ca-4189-9d76-31f3187dffbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:57.007811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dea224-67ca-4189-9d76-31f3187dffbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:57.010129 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dea224-67ca-4189-9d76-31f3187dffbf service glance] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:57.032603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1288/2538] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:15:57.128180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd245f-178f-4bfa-be83-1c5409a8aba7 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:57.128472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd245f-178f-4bfa-be83-1c5409a8aba7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:57.128766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd245f-178f-4bfa-be83-1c5409a8aba7 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:57.130497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1251/2539] 10.222.0.76 () {54 vars in 921 bytes} [Mon Sep 19 17:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 17:15:57.139350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f241b-a32c-42c6-ad62-45b48fc9468b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:57.139763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f241b-a32c-42c6-ad62-45b48fc9468b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:57.139876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f241b-a32c-42c6-ad62-45b48fc9468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:57.171601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ee8f241b-a32c-42c6-ad62-45b48fc9468b None None] MFA Rules not processed for user `da4a83dd0cb64e219bc16f8cf0b0af57`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:15:57.175290 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ee8f241b-a32c-42c6-ad62-45b48fc9468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:57.189254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1289/2540] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Sep 19 17:15:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:15:57.202988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd245f-178f-4bfa-be83-1c5409a8aba7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:15:57.205450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-67cd245f-178f-4bfa-be83-1c5409a8aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:15:57.230191 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd245f-178f-4bfa-be83-1c5409a8aba7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:15:57.241936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52de89-bfa8-4a5e-ae9f-1ddcb5797b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:15:57.242863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52de89-bfa8-4a5e-ae9f-1ddcb5797b11 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:15:57.245540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52de89-bfa8-4a5e-ae9f-1ddcb5797b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:15:57.245809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52de89-bfa8-4a5e-ae9f-1ddcb5797b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:15:57.256960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52de89-bfa8-4a5e-ae9f-1ddcb5797b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:15:57.258992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52de89-bfa8-4a5e-ae9f-1ddcb5797b11 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:15:57.280791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1252/2541] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:15:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:00.219865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ab4db-20f9-4e80-9810-eece8d94d97d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:00.220395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ab4db-20f9-4e80-9810-eece8d94d97d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:00.220560 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ab4db-20f9-4e80-9810-eece8d94d97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:00.240221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ac1ab4db-20f9-4e80-9810-eece8d94d97d None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:00.241463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ac1ab4db-20f9-4e80-9810-eece8d94d97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:00.300455 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1290/2542] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:16:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:00.323717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52de89-bfa8-4a5e-ae9f-1ddcb5797b11 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:00.325264 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0a52de89-bfa8-4a5e-ae9f-1ddcb5797b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:00.400006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52de89-bfa8-4a5e-ae9f-1ddcb5797b11 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:00.405637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e75a7d-845e-4f69-bfcf-047cdc0f718f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:00.406270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75a7d-845e-4f69-bfcf-047cdc0f718f service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:00.406545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75a7d-845e-4f69-bfcf-047cdc0f718f service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:00.406815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75a7d-845e-4f69-bfcf-047cdc0f718f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:00.416046 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e75a7d-845e-4f69-bfcf-047cdc0f718f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:00.417727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e75a7d-845e-4f69-bfcf-047cdc0f718f service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:00.426728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1253/2543] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:16:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:16:10.190637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ab4db-20f9-4e80-9810-eece8d94d97d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:10.259175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ab4db-20f9-4e80-9810-eece8d94d97d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:10.263967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:10.264683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:10.264961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:10.265273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] PATH_INFO: `/v3/users/09efc78e2d7b4d098aa347834303f5dd` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:10.266427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=09efc78e2d7b4d098aa347834303f5dd)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:10.268366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:10.319729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09efc78e2d7b4d098aa347834303f5dd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:10.320381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09efc78e2d7b4d098aa347834303f5dd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:10.322515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:10.336060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09efc78e2d7b4d098aa347834303f5dd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:10.345513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09efc78e2d7b4d098aa347834303f5dd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:10.349351 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09efc78e2d7b4d098aa347834303f5dd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:10.363964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1291/2544] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:10 2022] DELETE /identity/v3/users/09efc78e2d7b4d098aa347834303f5dd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:10.368654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28769-d91a-4b58-b9b2-4d871b72d127 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:10.369218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28769-d91a-4b58-b9b2-4d871b72d127 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:10.369321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28769-d91a-4b58-b9b2-4d871b72d127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:10.389647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-faa28769-d91a-4b58-b9b2-4d871b72d127 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:10.390769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-faa28769-d91a-4b58-b9b2-4d871b72d127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:10.454938 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1254/2545] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:10.465244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:10.466779 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:10.535526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1be61-4aee-4fd7-8498-79a531287f6d admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:10.539339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164b852-642f-478c-ab32-c2da39878bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:10.539961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164b852-642f-478c-ab32-c2da39878bce service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:10.540239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164b852-642f-478c-ab32-c2da39878bce service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:10.540514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164b852-642f-478c-ab32-c2da39878bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:10.550015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164b852-642f-478c-ab32-c2da39878bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:10.551449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164b852-642f-478c-ab32-c2da39878bce service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:10.561915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1292/2546] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:11.036437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28769-d91a-4b58-b9b2-4d871b72d127 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:11.037931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-faa28769-d91a-4b58-b9b2-4d871b72d127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:11.050066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28769-d91a-4b58-b9b2-4d871b72d127 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:11.055079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:11.055720 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:11.055995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:11.056268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] PATH_INFO: `/v3/projects/6241d77c531c4cff9d15879cfa9cd8d3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:11.057489 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6241d77c531c4cff9d15879cfa9cd8d3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:11.059420 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:11.113486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6241d77c531c4cff9d15879cfa9cd8d3', 'request_id': 'req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.115731 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:11.122688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6241d77c531c4cff9d15879cfa9cd8d3', 'request_id': 'req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.137064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6241d77c531c4cff9d15879cfa9cd8d3', 'request_id': 'req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.154511 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] The token cache is being invalidate because project 6241d77c531c4cff9d15879cfa9cd8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:11.154808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.155544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.157359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1255/2547] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:11 2022] DELETE /identity/v3/projects/6241d77c531c4cff9d15879cfa9cd8d3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:11.161446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164b852-642f-478c-ab32-c2da39878bce service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:11.172524 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164b852-642f-478c-ab32-c2da39878bce service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:11.239255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:11.240002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:11.240183 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:11.240461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] PATH_INFO: `/v3/users/915190954f804f2e89ceff5792dc3eed` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:11.241631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=915190954f804f2e89ceff5792dc3eed)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:11.243626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:11.304671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915190954f804f2e89ceff5792dc3eed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.305434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915190954f804f2e89ceff5792dc3eed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.318124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915190954f804f2e89ceff5792dc3eed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.326125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915190954f804f2e89ceff5792dc3eed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.327536 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-59673d07-7a88-4d76-b14d-d9575e7432b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915190954f804f2e89ceff5792dc3eed'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.328891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:11.343534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1293/2548] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:11 2022] DELETE /identity/v3/users/915190954f804f2e89ceff5792dc3eed => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:11.626696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:11.628244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:11.641612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e48a0-0f2b-4564-8385-0403aa6bf1d1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:11.700961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:11.701610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:11.701887 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:11.702179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] PATH_INFO: `/v3/projects/73f7a73c50664803aadb53a5f076e79f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:11.703373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f7a73c50664803aadb53a5f076e79f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:11.705394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:11.753626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f7a73c50664803aadb53a5f076e79f', 'request_id': 'req-9d0c8ef0-c855-44d4-a140-12c91bcee430'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.759334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f7a73c50664803aadb53a5f076e79f', 'request_id': 'req-9d0c8ef0-c855-44d4-a140-12c91bcee430'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.767955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f7a73c50664803aadb53a5f076e79f', 'request_id': 'req-9d0c8ef0-c855-44d4-a140-12c91bcee430'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.779372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] The token cache is being invalidate because project 73f7a73c50664803aadb53a5f076e79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:11.779664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.780379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9d0c8ef0-c855-44d4-a140-12c91bcee430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:11.782028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1256/2549] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:11 2022] DELETE /identity/v3/projects/73f7a73c50664803aadb53a5f076e79f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:11.787054 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5792b3-0f9c-407b-83e5-53bdf6f055ce None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:11.787346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5792b3-0f9c-407b-83e5-53bdf6f055ce None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:11.787624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5792b3-0f9c-407b-83e5-53bdf6f055ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:11.808599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2e5792b3-0f9c-407b-83e5-53bdf6f055ce None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:11.809856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2e5792b3-0f9c-407b-83e5-53bdf6f055ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:11.871907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1294/2550] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:11.881611 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0e325-9903-480a-a322-c91ecb7fcf1e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:11.881895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0e325-9903-480a-a322-c91ecb7fcf1e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:11.882168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0e325-9903-480a-a322-c91ecb7fcf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:11.904218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-69d0e325-9903-480a-a322-c91ecb7fcf1e None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:11.905426 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-69d0e325-9903-480a-a322-c91ecb7fcf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:11.914126 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1257/2551] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:11.919570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5792b3-0f9c-407b-83e5-53bdf6f055ce None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:11.930660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5792b3-0f9c-407b-83e5-53bdf6f055ce None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:11.936842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c245f-2673-45d7-9950-dff6c2c92961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:11.937491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c245f-2673-45d7-9950-dff6c2c92961 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:11.937768 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c245f-2673-45d7-9950-dff6c2c92961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:11.938040 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c245f-2673-45d7-9950-dff6c2c92961 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:11.938723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c245f-2673-45d7-9950-dff6c2c92961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:16:11.939036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c245f-2673-45d7-9950-dff6c2c92961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:11.940654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c245f-2673-45d7-9950-dff6c2c92961 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:11.953137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1295/2552] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:16:11.958361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0e325-9903-480a-a322-c91ecb7fcf1e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:11.973197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0e325-9903-480a-a322-c91ecb7fcf1e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:11.981296 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013ef96-d1e3-4fbf-b9c1-3799cfb623f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:11.982038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ef96-d1e3-4fbf-b9c1-3799cfb623f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:11.982317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ef96-d1e3-4fbf-b9c1-3799cfb623f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:11.982618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ef96-d1e3-4fbf-b9c1-3799cfb623f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:11.983382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013ef96-d1e3-4fbf-b9c1-3799cfb623f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:11.985366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013ef96-d1e3-4fbf-b9c1-3799cfb623f8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.021944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1258/2553] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:16:11 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:12.023402 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c245f-2673-45d7-9950-dff6c2c92961 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.037894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c245f-2673-45d7-9950-dff6c2c92961 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:12.097559 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828730ba-5327-4e16-b715-16bf1de757fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:12.098177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828730ba-5327-4e16-b715-16bf1de757fd admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.098491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828730ba-5327-4e16-b715-16bf1de757fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.098795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828730ba-5327-4e16-b715-16bf1de757fd admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.099431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828730ba-5327-4e16-b715-16bf1de757fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:12.101413 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828730ba-5327-4e16-b715-16bf1de757fd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.131493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1296/2554] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:16:12 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:12.132271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013ef96-d1e3-4fbf-b9c1-3799cfb623f8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.147007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013ef96-d1e3-4fbf-b9c1-3799cfb623f8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:12.161261 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a52a39-ebe5-4f6b-b37c-b9000254466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:12.162116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a52a39-ebe5-4f6b-b37c-b9000254466e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.162392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a52a39-ebe5-4f6b-b37c-b9000254466e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.162659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a52a39-ebe5-4f6b-b37c-b9000254466e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.163394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a52a39-ebe5-4f6b-b37c-b9000254466e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:12.164925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a52a39-ebe5-4f6b-b37c-b9000254466e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.175829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1259/2555] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:12.179582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828730ba-5327-4e16-b715-16bf1de757fd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.191097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828730ba-5327-4e16-b715-16bf1de757fd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:12.196254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d17d27-e416-4d1d-a5f2-161ca7392be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:12.196875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d17d27-e416-4d1d-a5f2-161ca7392be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.197185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d17d27-e416-4d1d-a5f2-161ca7392be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.197466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d17d27-e416-4d1d-a5f2-161ca7392be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.198262 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d17d27-e416-4d1d-a5f2-161ca7392be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:12.200046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d17d27-e416-4d1d-a5f2-161ca7392be5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.216053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a52a39-ebe5-4f6b-b37c-b9000254466e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.221317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1297/2556] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:12.230222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a52a39-ebe5-4f6b-b37c-b9000254466e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:12.237945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411d21e-caba-421c-a434-a216c17f5461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:12.238899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411d21e-caba-421c-a434-a216c17f5461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.239261 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411d21e-caba-421c-a434-a216c17f5461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.239633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411d21e-caba-421c-a434-a216c17f5461 admin admin] PATH_INFO: `/v3/projects/91941ddcccf7434c8f3a5c067462589a/users/8ba0b1ab21804804af01a45f5d628ab1/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.268035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411d21e-caba-421c-a434-a216c17f5461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91941ddcccf7434c8f3a5c067462589a, user_id=8ba0b1ab21804804af01a45f5d628ab1, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:12.270885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411d21e-caba-421c-a434-a216c17f5461 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.289914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1260/2557] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:16:12 2022] PUT /identity/v3/projects/91941ddcccf7434c8f3a5c067462589a/users/8ba0b1ab21804804af01a45f5d628ab1/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:12.301555 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72529d3-9915-4310-8a94-dea3049764f0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.302104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72529d3-9915-4310-8a94-dea3049764f0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.302104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72529d3-9915-4310-8a94-dea3049764f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.331882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-e72529d3-9915-4310-8a94-dea3049764f0 None None] MFA Rules not processed for user `8ba0b1ab21804804af01a45f5d628ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:12.333293 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-e72529d3-9915-4310-8a94-dea3049764f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:12.377160 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:12.399600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1298/2558] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:12.404380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411d21e-caba-421c-a434-a216c17f5461 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.410621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:12.473340 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411d21e-caba-421c-a434-a216c17f5461 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:12.478455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cba740-f3ac-4f79-846a-fe209a0c13ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:12.479056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cba740-f3ac-4f79-846a-fe209a0c13ac admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.479334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cba740-f3ac-4f79-846a-fe209a0c13ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.479602 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cba740-f3ac-4f79-846a-fe209a0c13ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.480236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cba740-f3ac-4f79-846a-fe209a0c13ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:12.482208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cba740-f3ac-4f79-846a-fe209a0c13ac admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.511741 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1261/2559] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:16:12 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:12.516009 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72529d3-9915-4310-8a94-dea3049764f0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.527324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72529d3-9915-4310-8a94-dea3049764f0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:12.597493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492bb4b-0da2-4394-ad32-c934466dde71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:12.598318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492bb4b-0da2-4394-ad32-c934466dde71 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.598698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492bb4b-0da2-4394-ad32-c934466dde71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.598983 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492bb4b-0da2-4394-ad32-c934466dde71 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.599603 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492bb4b-0da2-4394-ad32-c934466dde71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:12.602288 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492bb4b-0da2-4394-ad32-c934466dde71 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.631858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1299/2560] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:16:12 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:12.636199 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cba740-f3ac-4f79-846a-fe209a0c13ac admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.646976 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cba740-f3ac-4f79-846a-fe209a0c13ac admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:12.652552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4f1bf-3028-4496-9b2b-32ef413d1dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:12.653170 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f1bf-3028-4496-9b2b-32ef413d1dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.653454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f1bf-3028-4496-9b2b-32ef413d1dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.653737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f1bf-3028-4496-9b2b-32ef413d1dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.654375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4f1bf-3028-4496-9b2b-32ef413d1dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:12.655983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4f1bf-3028-4496-9b2b-32ef413d1dd8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.668278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1262/2561] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:12.672419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492bb4b-0da2-4394-ad32-c934466dde71 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.683049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492bb4b-0da2-4394-ad32-c934466dde71 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:12.688315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfea0f-4b53-4567-a37f-009ffeb2a9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:12.688973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfea0f-4b53-4567-a37f-009ffeb2a9af admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.689294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfea0f-4b53-4567-a37f-009ffeb2a9af admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.689570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfea0f-4b53-4567-a37f-009ffeb2a9af admin admin] PATH_INFO: `/v3/projects/90d2984fbbfd4b1c913e422821f9d2c2/users/9fc880bad70c4ec99ed6b20573acf6a3/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.704900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfea0f-4b53-4567-a37f-009ffeb2a9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d2984fbbfd4b1c913e422821f9d2c2, user_id=9fc880bad70c4ec99ed6b20573acf6a3, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:12.707613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfea0f-4b53-4567-a37f-009ffeb2a9af admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.722787 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1300/2562] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:16:12 2022] PUT /identity/v3/projects/90d2984fbbfd4b1c913e422821f9d2c2/users/9fc880bad70c4ec99ed6b20573acf6a3/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:12.727069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4f1bf-3028-4496-9b2b-32ef413d1dd8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.737696 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4f1bf-3028-4496-9b2b-32ef413d1dd8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:12.798219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f699140-0b7e-4991-8308-d72e70b783dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:12.798819 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f699140-0b7e-4991-8308-d72e70b783dd admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.799096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f699140-0b7e-4991-8308-d72e70b783dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.799368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f699140-0b7e-4991-8308-d72e70b783dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.800012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f699140-0b7e-4991-8308-d72e70b783dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:12.801667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f699140-0b7e-4991-8308-d72e70b783dd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.811451 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1263/2563] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:12.815895 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfea0f-4b53-4567-a37f-009ffeb2a9af admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.826692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfea0f-4b53-4567-a37f-009ffeb2a9af admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:12.831831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2549-ab9c-4055-a153-d7866737a144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:12.832480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2549-ab9c-4055-a153-d7866737a144 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.832724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2549-ab9c-4055-a153-d7866737a144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.833060 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2549-ab9c-4055-a153-d7866737a144 admin admin] PATH_INFO: `/v3/projects/90d2984fbbfd4b1c913e422821f9d2c2/users/9fc880bad70c4ec99ed6b20573acf6a3/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.835092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2549-ab9c-4055-a153-d7866737a144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d2984fbbfd4b1c913e422821f9d2c2, user_id=9fc880bad70c4ec99ed6b20573acf6a3, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:12.837926 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2549-ab9c-4055-a153-d7866737a144 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:12.848572 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1301/2564] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:16:12 2022] PUT /identity/v3/projects/90d2984fbbfd4b1c913e422821f9d2c2/users/9fc880bad70c4ec99ed6b20573acf6a3/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:12.858900 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769b88-03ba-4799-adf9-bbceda48cfe7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:12.859184 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769b88-03ba-4799-adf9-bbceda48cfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:12.859496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769b88-03ba-4799-adf9-bbceda48cfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:12.889460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0f769b88-03ba-4799-adf9-bbceda48cfe7 None None] MFA Rules not processed for user `9fc880bad70c4ec99ed6b20573acf6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:12.890686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0f769b88-03ba-4799-adf9-bbceda48cfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:12.964700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:12.972154 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1264/2565] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:12.982551 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2549-ab9c-4055-a153-d7866737a144 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:12.984282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b7b2549-ab9c-4055-a153-d7866737a144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:13.042719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2549-ab9c-4055-a153-d7866737a144 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:13.046602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c388e4d-bece-43c0-b738-5bcf48984d2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:13.047211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388e4d-bece-43c0-b738-5bcf48984d2e service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:13.047488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388e4d-bece-43c0-b738-5bcf48984d2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:13.047753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388e4d-bece-43c0-b738-5bcf48984d2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:13.057164 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c388e4d-bece-43c0-b738-5bcf48984d2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:13.058647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c388e4d-bece-43c0-b738-5bcf48984d2e service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:13.068580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1302/2566] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:13.194879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f769b88-03ba-4799-adf9-bbceda48cfe7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:13.205338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f769b88-03ba-4799-adf9-bbceda48cfe7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:13.209104 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6435fe0-8df7-4d8f-8523-2a03cd78e543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:13.209717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6435fe0-8df7-4d8f-8523-2a03cd78e543 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:13.209992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6435fe0-8df7-4d8f-8523-2a03cd78e543 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:13.210288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6435fe0-8df7-4d8f-8523-2a03cd78e543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:13.316029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6435fe0-8df7-4d8f-8523-2a03cd78e543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:13.319020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6435fe0-8df7-4d8f-8523-2a03cd78e543 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:13.331208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1265/2567] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:15.418687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6a1a6-4d37-4b7a-9353-085d2318842d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:15.419182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6a1a6-4d37-4b7a-9353-085d2318842d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:15.419182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6a1a6-4d37-4b7a-9353-085d2318842d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:15.440667 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-07c6a1a6-4d37-4b7a-9353-085d2318842d None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:15.441920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-07c6a1a6-4d37-4b7a-9353-085d2318842d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:15.479685 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:15.506990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1303/2568] 10.222.0.76 () {58 vars in 967 bytes} [Mon Sep 19 17:16:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:15.519522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6435fe0-8df7-4d8f-8523-2a03cd78e543 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:15.521225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d6435fe0-8df7-4d8f-8523-2a03cd78e543 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:15.593567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6435fe0-8df7-4d8f-8523-2a03cd78e543 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:15.599955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104ae78-5425-4a22-b676-fa4bf0fba994 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:15.600571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104ae78-5425-4a22-b676-fa4bf0fba994 service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:15.600845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104ae78-5425-4a22-b676-fa4bf0fba994 service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:15.601143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104ae78-5425-4a22-b676-fa4bf0fba994 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:15.610532 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104ae78-5425-4a22-b676-fa4bf0fba994 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:15.612141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104ae78-5425-4a22-b676-fa4bf0fba994 service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:15.620695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1266/2569] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:16:16.202929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6a1a6-4d37-4b7a-9353-085d2318842d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:16.273574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6a1a6-4d37-4b7a-9353-085d2318842d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:16.278359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:16.278998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:16.279301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:16.279575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] PATH_INFO: `/v3/users/8ba0b1ab21804804af01a45f5d628ab1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:16.280708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba0b1ab21804804af01a45f5d628ab1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:16.282684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:16.334648 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba0b1ab21804804af01a45f5d628ab1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:16.335377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba0b1ab21804804af01a45f5d628ab1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:16.348122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba0b1ab21804804af01a45f5d628ab1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:16.356783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba0b1ab21804804af01a45f5d628ab1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:16.357422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba0b1ab21804804af01a45f5d628ab1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:16.370145 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1304/2570] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:16 2022] DELETE /identity/v3/users/8ba0b1ab21804804af01a45f5d628ab1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:16.374884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf82e4-582c-4e7c-942b-3d309133cb98 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:16.375591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf82e4-582c-4e7c-942b-3d309133cb98 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:16.375837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf82e4-582c-4e7c-942b-3d309133cb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:16.396133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d2bf82e4-582c-4e7c-942b-3d309133cb98 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:16.397381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d2bf82e4-582c-4e7c-942b-3d309133cb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:16.462737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1267/2571] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:16.472433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:16.473972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:16.534593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a96fb-44a7-4a44-a809-5565a0aa6ad1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:16.539722 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25afca-f5bd-4453-9d46-7c2d8d639520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:16.540329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25afca-f5bd-4453-9d46-7c2d8d639520 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:16.540601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25afca-f5bd-4453-9d46-7c2d8d639520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:16.540922 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25afca-f5bd-4453-9d46-7c2d8d639520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:16.551404 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25afca-f5bd-4453-9d46-7c2d8d639520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:16.552833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25afca-f5bd-4453-9d46-7c2d8d639520 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:16.562452 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1305/2572] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:16:16.851814 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf82e4-582c-4e7c-942b-3d309133cb98 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:16.853417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d2bf82e4-582c-4e7c-942b-3d309133cb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:16.868071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf82e4-582c-4e7c-942b-3d309133cb98 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:16.873922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:16.874578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:16.874835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:16.875531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] PATH_INFO: `/v3/projects/91941ddcccf7434c8f3a5c067462589a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:16.876735 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91941ddcccf7434c8f3a5c067462589a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:16.878722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:16.904853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:16.930559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91941ddcccf7434c8f3a5c067462589a', 'request_id': 'req-707d3da1-37b7-449c-b75a-e85819299452'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:16.937272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91941ddcccf7434c8f3a5c067462589a', 'request_id': 'req-707d3da1-37b7-449c-b75a-e85819299452'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:16.946245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91941ddcccf7434c8f3a5c067462589a', 'request_id': 'req-707d3da1-37b7-449c-b75a-e85819299452'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:16.957958 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] The token cache is being invalidate because project 91941ddcccf7434c8f3a5c067462589a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:16.958284 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:16.958989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:16.960582 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1268/2573] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:16 2022] DELETE /identity/v3/projects/91941ddcccf7434c8f3a5c067462589a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:16.964996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25afca-f5bd-4453-9d46-7c2d8d639520 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:16.975668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25afca-f5bd-4453-9d46-7c2d8d639520 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:16.979449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:17.037011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:17.037692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:17.037976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:17.038250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] PATH_INFO: `/v3/users/9fc880bad70c4ec99ed6b20573acf6a3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:17.039486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc880bad70c4ec99ed6b20573acf6a3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:17.041579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:17.092363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc880bad70c4ec99ed6b20573acf6a3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:17.093130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc880bad70c4ec99ed6b20573acf6a3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:17.105386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc880bad70c4ec99ed6b20573acf6a3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:17.115448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc880bad70c4ec99ed6b20573acf6a3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:17.116234 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc880bad70c4ec99ed6b20573acf6a3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:17.129296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1306/2574] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:16 2022] DELETE /identity/v3/users/9fc880bad70c4ec99ed6b20573acf6a3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:17.162701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:17.164340 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:17.244997 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d3da1-37b7-449c-b75a-e85819299452 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:17.316058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36603bc9-5e55-4077-9212-92011384a2ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:17.316680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36603bc9-5e55-4077-9212-92011384a2ec service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:17.317003 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36603bc9-5e55-4077-9212-92011384a2ec service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:17.317806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36603bc9-5e55-4077-9212-92011384a2ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:17.320349 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-36603bc9-5e55-4077-9212-92011384a2ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:17.372002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:17.393867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36603bc9-5e55-4077-9212-92011384a2ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:17.393867 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36603bc9-5e55-4077-9212-92011384a2ec service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:17.402461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1269/2575] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:17.519755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:17.521401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:17.595360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe63769-9c6c-4108-9763-032a6771d6da admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:17.600032 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:17.600689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:17.600970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:17.601280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] PATH_INFO: `/v3/projects/90d2984fbbfd4b1c913e422821f9d2c2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:17.602427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d2984fbbfd4b1c913e422821f9d2c2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:17.604430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:17.642037 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:17.659052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d2984fbbfd4b1c913e422821f9d2c2', 'request_id': 'req-86b53b88-75b1-451e-8bfe-3ca23c1e348f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:17.665163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d2984fbbfd4b1c913e422821f9d2c2', 'request_id': 'req-86b53b88-75b1-451e-8bfe-3ca23c1e348f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:17.674132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d2984fbbfd4b1c913e422821f9d2c2', 'request_id': 'req-86b53b88-75b1-451e-8bfe-3ca23c1e348f'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:17.687281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] The token cache is being invalidate because project 90d2984fbbfd4b1c913e422821f9d2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:17.687530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:17.688284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-86b53b88-75b1-451e-8bfe-3ca23c1e348f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:17.690502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1307/2576] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:17 2022] DELETE /identity/v3/projects/90d2984fbbfd4b1c913e422821f9d2c2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:17.696406 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf52a-5f91-4111-bf61-84e3f93ff333 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:17.696937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf52a-5f91-4111-bf61-84e3f93ff333 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:17.697263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cf52a-5f91-4111-bf61-84e3f93ff333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:17.717208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-837cf52a-5f91-4111-bf61-84e3f93ff333 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:17.718422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-837cf52a-5f91-4111-bf61-84e3f93ff333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:17.781351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1270/2577] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:16:17.788851 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e57a4-113c-490e-954c-9c73e96ba754 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:17.789168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e57a4-113c-490e-954c-9c73e96ba754 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:17.789453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e57a4-113c-490e-954c-9c73e96ba754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:17.809642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-434e57a4-113c-490e-954c-9c73e96ba754 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:17.810868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-434e57a4-113c-490e-954c-9c73e96ba754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:17.819616 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1308/2578] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:17.824408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cf52a-5f91-4111-bf61-84e3f93ff333 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:17.838861 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cf52a-5f91-4111-bf61-84e3f93ff333 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:17.843661 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97b82e-2498-4adf-9103-6fa58bd8a280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:17.844299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97b82e-2498-4adf-9103-6fa58bd8a280 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:17.844565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97b82e-2498-4adf-9103-6fa58bd8a280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:17.844832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97b82e-2498-4adf-9103-6fa58bd8a280 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:17.845481 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97b82e-2498-4adf-9103-6fa58bd8a280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:16:17.845779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97b82e-2498-4adf-9103-6fa58bd8a280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:17.847374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97b82e-2498-4adf-9103-6fa58bd8a280 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:17.859613 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1271/2579] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:16:17.863929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e57a4-113c-490e-954c-9c73e96ba754 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:17.873395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e57a4-113c-490e-954c-9c73e96ba754 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:17.878717 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85689c1-1d07-4185-a4b8-f58bcb83e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:17.879317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85689c1-1d07-4185-a4b8-f58bcb83e044 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:17.879571 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85689c1-1d07-4185-a4b8-f58bcb83e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:17.879844 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85689c1-1d07-4185-a4b8-f58bcb83e044 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:17.880474 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85689c1-1d07-4185-a4b8-f58bcb83e044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:17.882430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85689c1-1d07-4185-a4b8-f58bcb83e044 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:17.912441 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1309/2580] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:16:17 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:16:17.916835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97b82e-2498-4adf-9103-6fa58bd8a280 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:17.927485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97b82e-2498-4adf-9103-6fa58bd8a280 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:17.985319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011a101-6e29-47ae-9ef6-4184471ed04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:17.985934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a101-6e29-47ae-9ef6-4184471ed04e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:17.986214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a101-6e29-47ae-9ef6-4184471ed04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:17.986484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a101-6e29-47ae-9ef6-4184471ed04e admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:17.987121 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011a101-6e29-47ae-9ef6-4184471ed04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:17.989068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011a101-6e29-47ae-9ef6-4184471ed04e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.012415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1272/2581] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:16:17 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:18.016714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85689c1-1d07-4185-a4b8-f58bcb83e044 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.027942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85689c1-1d07-4185-a4b8-f58bcb83e044 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.032921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d325a-e71d-4a33-a3cd-16251ffce1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.033564 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d325a-e71d-4a33-a3cd-16251ffce1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.033874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d325a-e71d-4a33-a3cd-16251ffce1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.034151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d325a-e71d-4a33-a3cd-16251ffce1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.034798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d325a-e71d-4a33-a3cd-16251ffce1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.036410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d325a-e71d-4a33-a3cd-16251ffce1c9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.047184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1310/2582] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:18.051289 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011a101-6e29-47ae-9ef6-4184471ed04e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.062084 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011a101-6e29-47ae-9ef6-4184471ed04e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.067905 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03f4b0-ae2b-4045-ad0f-7d2c5dd70dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.068503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f4b0-ae2b-4045-ad0f-7d2c5dd70dea admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.068780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f4b0-ae2b-4045-ad0f-7d2c5dd70dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.069063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f4b0-ae2b-4045-ad0f-7d2c5dd70dea admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.069727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03f4b0-ae2b-4045-ad0f-7d2c5dd70dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.071331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03f4b0-ae2b-4045-ad0f-7d2c5dd70dea admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.082658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1273/2583] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:18.086930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d325a-e71d-4a33-a3cd-16251ffce1c9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.097467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d325a-e71d-4a33-a3cd-16251ffce1c9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.103431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72a8be-ea25-4630-9af1-0090657437bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.104205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72a8be-ea25-4630-9af1-0090657437bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.104483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72a8be-ea25-4630-9af1-0090657437bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.104760 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72a8be-ea25-4630-9af1-0090657437bd admin admin] PATH_INFO: `/v3/projects/59abbd295faa4e319ce0321fcfc677ff/users/98c8ec0c2c6446919805a01e1cfd87ab/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.120226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72a8be-ea25-4630-9af1-0090657437bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=59abbd295faa4e319ce0321fcfc677ff, user_id=98c8ec0c2c6446919805a01e1cfd87ab, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.122920 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72a8be-ea25-4630-9af1-0090657437bd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.139077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1311/2584] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:16:18 2022] PUT /identity/v3/projects/59abbd295faa4e319ce0321fcfc677ff/users/98c8ec0c2c6446919805a01e1cfd87ab/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:18.149667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00f64-f97a-41a0-9af7-1309d8a559e0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.149959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00f64-f97a-41a0-9af7-1309d8a559e0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.150371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00f64-f97a-41a0-9af7-1309d8a559e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.180189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cdc00f64-f97a-41a0-9af7-1309d8a559e0 None None] MFA Rules not processed for user `98c8ec0c2c6446919805a01e1cfd87ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:18.181446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cdc00f64-f97a-41a0-9af7-1309d8a559e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:18.225266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:18.250944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1274/2585] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:18.255802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72a8be-ea25-4630-9af1-0090657437bd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.318596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72a8be-ea25-4630-9af1-0090657437bd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.323704 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fee56c-67be-4ee3-ac39-e86753dc8973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.324313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fee56c-67be-4ee3-ac39-e86753dc8973 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.324592 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fee56c-67be-4ee3-ac39-e86753dc8973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.324863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fee56c-67be-4ee3-ac39-e86753dc8973 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.325507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fee56c-67be-4ee3-ac39-e86753dc8973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.327409 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fee56c-67be-4ee3-ac39-e86753dc8973 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.356936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1312/2586] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:16:18 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:18.360797 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00f64-f97a-41a0-9af7-1309d8a559e0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.371992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00f64-f97a-41a0-9af7-1309d8a559e0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.431371 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dec2d-aed2-4698-9230-62f493c76e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.432218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dec2d-aed2-4698-9230-62f493c76e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.432479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dec2d-aed2-4698-9230-62f493c76e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.432777 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dec2d-aed2-4698-9230-62f493c76e84 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.433442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dec2d-aed2-4698-9230-62f493c76e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.435496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dec2d-aed2-4698-9230-62f493c76e84 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.461703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1275/2587] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:16:18 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:18.462999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fee56c-67be-4ee3-ac39-e86753dc8973 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.474062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fee56c-67be-4ee3-ac39-e86753dc8973 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.479624 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d5363-ad07-4e3d-8afb-f4233bf45e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.480298 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d5363-ad07-4e3d-8afb-f4233bf45e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.480646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d5363-ad07-4e3d-8afb-f4233bf45e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.480953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d5363-ad07-4e3d-8afb-f4233bf45e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.481633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d5363-ad07-4e3d-8afb-f4233bf45e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.483236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d5363-ad07-4e3d-8afb-f4233bf45e8e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.498742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1313/2588] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:18.500580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dec2d-aed2-4698-9230-62f493c76e84 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.510689 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dec2d-aed2-4698-9230-62f493c76e84 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.515434 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8aa03b-cd63-49d3-841f-4b6bdc48ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.516027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa03b-cd63-49d3-841f-4b6bdc48ea1a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.516308 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa03b-cd63-49d3-841f-4b6bdc48ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.516589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa03b-cd63-49d3-841f-4b6bdc48ea1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.517282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8aa03b-cd63-49d3-841f-4b6bdc48ea1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.518931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8aa03b-cd63-49d3-841f-4b6bdc48ea1a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.529384 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1276/2589] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:18.533472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d5363-ad07-4e3d-8afb-f4233bf45e8e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.543745 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d5363-ad07-4e3d-8afb-f4233bf45e8e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.548803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbf4e1-6c80-49e7-a96c-860af931c658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.549502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbf4e1-6c80-49e7-a96c-860af931c658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.549809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbf4e1-6c80-49e7-a96c-860af931c658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.550097 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbf4e1-6c80-49e7-a96c-860af931c658 admin admin] PATH_INFO: `/v3/projects/cab0d270cd3b48c78d0526a0cb7609a8/users/a546fa1f288e430fa6639f32696ed035/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.565292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbf4e1-6c80-49e7-a96c-860af931c658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab0d270cd3b48c78d0526a0cb7609a8, user_id=a546fa1f288e430fa6639f32696ed035, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.568305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbf4e1-6c80-49e7-a96c-860af931c658 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.582617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1314/2590] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:16:18 2022] PUT /identity/v3/projects/cab0d270cd3b48c78d0526a0cb7609a8/users/a546fa1f288e430fa6639f32696ed035/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:18.653418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533493db-633e-46e9-92e9-7a90a02714ef None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.653725 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533493db-633e-46e9-92e9-7a90a02714ef None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.654079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533493db-633e-46e9-92e9-7a90a02714ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.685838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-533493db-633e-46e9-92e9-7a90a02714ef None None] MFA Rules not processed for user `a546fa1f288e430fa6639f32696ed035`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:18.687112 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-533493db-633e-46e9-92e9-7a90a02714ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:18.754280 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1277/2591] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:18.758897 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbf4e1-6c80-49e7-a96c-860af931c658 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.763849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:18.824854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbf4e1-6c80-49e7-a96c-860af931c658 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.829982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc93271-95e4-4666-9a89-d4bd78a18e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.830623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93271-95e4-4666-9a89-d4bd78a18e68 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.830908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93271-95e4-4666-9a89-d4bd78a18e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.831182 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93271-95e4-4666-9a89-d4bd78a18e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.831819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc93271-95e4-4666-9a89-d4bd78a18e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.833779 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc93271-95e4-4666-9a89-d4bd78a18e68 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.862083 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1315/2592] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:16:18 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:18.866094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533493db-633e-46e9-92e9-7a90a02714ef None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.877995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533493db-633e-46e9-92e9-7a90a02714ef None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.926429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:18.940901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a97fe-25ea-467b-871f-babd413b538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.941578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a97fe-25ea-467b-871f-babd413b538f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.941870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a97fe-25ea-467b-871f-babd413b538f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.942288 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a97fe-25ea-467b-871f-babd413b538f admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.942937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a97fe-25ea-467b-871f-babd413b538f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.944885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a97fe-25ea-467b-871f-babd413b538f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:18.967432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1278/2593] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:16:18 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:18.971869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc93271-95e4-4666-9a89-d4bd78a18e68 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:18.982734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc93271-95e4-4666-9a89-d4bd78a18e68 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:18.987431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c41fbb-ae58-443b-a3bf-3f8d00b238f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:18.988045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41fbb-ae58-443b-a3bf-3f8d00b238f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:18.988330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41fbb-ae58-443b-a3bf-3f8d00b238f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:18.988606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41fbb-ae58-443b-a3bf-3f8d00b238f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:18.989318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c41fbb-ae58-443b-a3bf-3f8d00b238f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:18.990927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c41fbb-ae58-443b-a3bf-3f8d00b238f6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:19.002540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1316/2594] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:19.006898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a97fe-25ea-467b-871f-babd413b538f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:19.018461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a97fe-25ea-467b-871f-babd413b538f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:19.024287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09329c1e-3ae4-4ed9-9274-9c8cfb48e7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:19.024966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09329c1e-3ae4-4ed9-9274-9c8cfb48e7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:19.025269 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09329c1e-3ae4-4ed9-9274-9c8cfb48e7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:19.025620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09329c1e-3ae4-4ed9-9274-9c8cfb48e7ef admin admin] PATH_INFO: `/v3/projects/15ac13ad8b274b97b9a3520c6f27e701/users/b6d8bd53e2644be1a081deb74593357d/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:19.044591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09329c1e-3ae4-4ed9-9274-9c8cfb48e7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ac13ad8b274b97b9a3520c6f27e701, user_id=b6d8bd53e2644be1a081deb74593357d, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:19.047317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09329c1e-3ae4-4ed9-9274-9c8cfb48e7ef admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:19.063048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1279/2595] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:16:19 2022] PUT /identity/v3/projects/15ac13ad8b274b97b9a3520c6f27e701/users/b6d8bd53e2644be1a081deb74593357d/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:19.067202 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c41fbb-ae58-443b-a3bf-3f8d00b238f6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:19.077683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c41fbb-ae58-443b-a3bf-3f8d00b238f6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:19.134576 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc22597-74fe-4dd1-b975-214da138940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:19.135236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc22597-74fe-4dd1-b975-214da138940b admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:19.135523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc22597-74fe-4dd1-b975-214da138940b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:19.135894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc22597-74fe-4dd1-b975-214da138940b admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:19.136583 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc22597-74fe-4dd1-b975-214da138940b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:19.138230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc22597-74fe-4dd1-b975-214da138940b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:19.148544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1317/2596] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:19.152859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09329c1e-3ae4-4ed9-9274-9c8cfb48e7ef admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:19.164390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09329c1e-3ae4-4ed9-9274-9c8cfb48e7ef admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:19.169842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86bf14-5518-46cc-a984-61cd0395a9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:19.170487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86bf14-5518-46cc-a984-61cd0395a9da admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:19.170793 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86bf14-5518-46cc-a984-61cd0395a9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:19.171088 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86bf14-5518-46cc-a984-61cd0395a9da admin admin] PATH_INFO: `/v3/projects/15ac13ad8b274b97b9a3520c6f27e701/users/b6d8bd53e2644be1a081deb74593357d/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:19.173520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86bf14-5518-46cc-a984-61cd0395a9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ac13ad8b274b97b9a3520c6f27e701, user_id=b6d8bd53e2644be1a081deb74593357d, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:19.176429 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86bf14-5518-46cc-a984-61cd0395a9da admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:19.187909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1280/2597] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:16:19 2022] PUT /identity/v3/projects/15ac13ad8b274b97b9a3520c6f27e701/users/b6d8bd53e2644be1a081deb74593357d/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:16:19.197837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a41ea-7801-4227-922f-cde3c26e6ec5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:19.198128 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a41ea-7801-4227-922f-cde3c26e6ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:19.198406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a41ea-7801-4227-922f-cde3c26e6ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:19.228842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1d8a41ea-7801-4227-922f-cde3c26e6ec5 None None] MFA Rules not processed for user `b6d8bd53e2644be1a081deb74593357d`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:19.230173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1d8a41ea-7801-4227-922f-cde3c26e6ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:19.297640 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:19.308155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1318/2598] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:19.315570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86bf14-5518-46cc-a984-61cd0395a9da admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:19.317379 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5c86bf14-5518-46cc-a984-61cd0395a9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:19.393345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86bf14-5518-46cc-a984-61cd0395a9da admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:19.396968 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26900cb9-5813-4439-a39f-7fc02ec6eaff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:19.397607 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26900cb9-5813-4439-a39f-7fc02ec6eaff service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:19.397886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26900cb9-5813-4439-a39f-7fc02ec6eaff service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:19.398156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26900cb9-5813-4439-a39f-7fc02ec6eaff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:19.407193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26900cb9-5813-4439-a39f-7fc02ec6eaff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:19.408635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26900cb9-5813-4439-a39f-7fc02ec6eaff service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:19.418454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1281/2599] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:19.461629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a41ea-7801-4227-922f-cde3c26e6ec5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:19.463071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1d8a41ea-7801-4227-922f-cde3c26e6ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:19.475212 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a41ea-7801-4227-922f-cde3c26e6ec5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:19.479397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed217f14-cfa8-4594-b495-a0292ecbe726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:19.480007 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed217f14-cfa8-4594-b495-a0292ecbe726 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:19.480282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed217f14-cfa8-4594-b495-a0292ecbe726 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:19.480556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed217f14-cfa8-4594-b495-a0292ecbe726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:19.540784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed217f14-cfa8-4594-b495-a0292ecbe726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:19.542493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed217f14-cfa8-4594-b495-a0292ecbe726 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:19.551811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1319/2600] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:19.637698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26900cb9-5813-4439-a39f-7fc02ec6eaff service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:19.639141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-26900cb9-5813-4439-a39f-7fc02ec6eaff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:19.727489 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26900cb9-5813-4439-a39f-7fc02ec6eaff service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:19.735728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0897977-6d94-4131-8145-954ce042f862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:19.736359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0897977-6d94-4131-8145-954ce042f862 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:19.736640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0897977-6d94-4131-8145-954ce042f862 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:19.736913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0897977-6d94-4131-8145-954ce042f862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:19.739300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c0897977-6d94-4131-8145-954ce042f862 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:19.755667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0897977-6d94-4131-8145-954ce042f862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:19.757425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0897977-6d94-4131-8145-954ce042f862 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:19.772641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1282/2601] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:22.562505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed217f14-cfa8-4594-b495-a0292ecbe726 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:22.627799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed217f14-cfa8-4594-b495-a0292ecbe726 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:22.632736 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:22.633427 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:22.633708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:22.633972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] PATH_INFO: `/v3/users/98c8ec0c2c6446919805a01e1cfd87ab` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:22.635135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c8ec0c2c6446919805a01e1cfd87ab)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:22.637167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:22.684749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c8ec0c2c6446919805a01e1cfd87ab'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:22.685444 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c8ec0c2c6446919805a01e1cfd87ab'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:22.697419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c8ec0c2c6446919805a01e1cfd87ab'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:22.706865 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c8ec0c2c6446919805a01e1cfd87ab'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:22.707535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c8ec0c2c6446919805a01e1cfd87ab'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:22.719798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1320/2602] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:22 2022] DELETE /identity/v3/users/98c8ec0c2c6446919805a01e1cfd87ab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:22.724592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eecb4-d0b6-4355-b2dc-b863582d4832 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:22.725056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eecb4-d0b6-4355-b2dc-b863582d4832 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:22.725314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2eecb4-d0b6-4355-b2dc-b863582d4832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:22.744341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fc2eecb4-d0b6-4355-b2dc-b863582d4832 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:22.745603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fc2eecb4-d0b6-4355-b2dc-b863582d4832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:22.771483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:22.807080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1283/2603] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:22.818086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:22.819702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:22.839074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:22.880445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ab3cc-bf17-4bc4-ac2f-2aa5fec9f674 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:22.884494 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e58afc-d471-436f-852c-16649efa754c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:22.885205 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e58afc-d471-436f-852c-16649efa754c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:22.885517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e58afc-d471-436f-852c-16649efa754c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:22.885806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e58afc-d471-436f-852c-16649efa754c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:22.895355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e58afc-d471-436f-852c-16649efa754c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:22.896789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e58afc-d471-436f-852c-16649efa754c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:22.906507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1321/2604] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:23.197069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2eecb4-d0b6-4355-b2dc-b863582d4832 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:23.198752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fc2eecb4-d0b6-4355-b2dc-b863582d4832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:23.211422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2eecb4-d0b6-4355-b2dc-b863582d4832 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:23.216408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:23.217111 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:23.217389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:23.217649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] PATH_INFO: `/v3/projects/59abbd295faa4e319ce0321fcfc677ff` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:23.218782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=59abbd295faa4e319ce0321fcfc677ff)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:23.221808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:23.271727 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59abbd295faa4e319ce0321fcfc677ff', 'request_id': 'req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.277559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59abbd295faa4e319ce0321fcfc677ff', 'request_id': 'req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.285641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59abbd295faa4e319ce0321fcfc677ff', 'request_id': 'req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.297217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] The token cache is being invalidate because project 59abbd295faa4e319ce0321fcfc677ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:23.297506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.298190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.299758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1284/2605] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:23 2022] DELETE /identity/v3/projects/59abbd295faa4e319ce0321fcfc677ff => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:23.303921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e58afc-d471-436f-852c-16649efa754c service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:23.313817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e58afc-d471-436f-852c-16649efa754c service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:23.371068 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:23.372401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:23.372687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:23.372963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] PATH_INFO: `/v3/users/a546fa1f288e430fa6639f32696ed035` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:23.374175 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a546fa1f288e430fa6639f32696ed035)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:23.376510 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:23.428642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a546fa1f288e430fa6639f32696ed035'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.429431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a546fa1f288e430fa6639f32696ed035'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.441915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a546fa1f288e430fa6639f32696ed035'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.450788 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a546fa1f288e430fa6639f32696ed035'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.451415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a546fa1f288e430fa6639f32696ed035'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.463467 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1322/2606] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:23 2022] DELETE /identity/v3/users/a546fa1f288e430fa6639f32696ed035 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:23.762205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:23.763800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:23.776859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c14f-2ecc-40f1-b59e-9b6065ff57ad admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:23.837488 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:23.838052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:23.838330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:23.838596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] PATH_INFO: `/v3/projects/cab0d270cd3b48c78d0526a0cb7609a8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:23.839780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab0d270cd3b48c78d0526a0cb7609a8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:23.841865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:23.892171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab0d270cd3b48c78d0526a0cb7609a8', 'request_id': 'req-73459d95-de0d-4da9-92da-cd175e2787cc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.896825 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:23.898130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab0d270cd3b48c78d0526a0cb7609a8', 'request_id': 'req-73459d95-de0d-4da9-92da-cd175e2787cc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.909516 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab0d270cd3b48c78d0526a0cb7609a8', 'request_id': 'req-73459d95-de0d-4da9-92da-cd175e2787cc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.921023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] The token cache is being invalidate because project cab0d270cd3b48c78d0526a0cb7609a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:23.921338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.922070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:23.923662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1285/2607] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:23 2022] DELETE /identity/v3/projects/cab0d270cd3b48c78d0526a0cb7609a8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:23.927996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:23.929458 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:23.943333 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb08c5-3c77-4950-80a9-7b4760fd814b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:23.977296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:24.002264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:24.002900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:24.003184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:24.003461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] PATH_INFO: `/v3/users/b6d8bd53e2644be1a081deb74593357d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:24.004627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d8bd53e2644be1a081deb74593357d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:24.006594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:24.056047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d8bd53e2644be1a081deb74593357d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:24.056711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d8bd53e2644be1a081deb74593357d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:24.069081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d8bd53e2644be1a081deb74593357d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:24.078698 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d8bd53e2644be1a081deb74593357d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:24.079428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3545f433-8609-4166-a13c-ac767efa6504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d8bd53e2644be1a081deb74593357d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:24.092302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1323/2608] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:23 2022] DELETE /identity/v3/users/b6d8bd53e2644be1a081deb74593357d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:24.382396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:24.383896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:24.398541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73459d95-de0d-4da9-92da-cd175e2787cc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:24.457620 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:24.458272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:24.458551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:24.458823 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] PATH_INFO: `/v3/projects/15ac13ad8b274b97b9a3520c6f27e701` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:24.459950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ac13ad8b274b97b9a3520c6f27e701)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:24.461979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:24.515609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ac13ad8b274b97b9a3520c6f27e701', 'request_id': 'req-99d5bcff-5229-4989-a65c-881dd3b1f0de'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:24.521461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ac13ad8b274b97b9a3520c6f27e701', 'request_id': 'req-99d5bcff-5229-4989-a65c-881dd3b1f0de'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:24.530052 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ac13ad8b274b97b9a3520c6f27e701', 'request_id': 'req-99d5bcff-5229-4989-a65c-881dd3b1f0de'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:24.542282 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] The token cache is being invalidate because project 15ac13ad8b274b97b9a3520c6f27e701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:24.542554 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:24.543245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-99d5bcff-5229-4989-a65c-881dd3b1f0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:24.544760 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1286/2609] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:24 2022] DELETE /identity/v3/projects/15ac13ad8b274b97b9a3520c6f27e701 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:24.550792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a5214-5abb-4b2f-9421-2cbc58c86b17 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:24.551085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a5214-5abb-4b2f-9421-2cbc58c86b17 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:24.551363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a5214-5abb-4b2f-9421-2cbc58c86b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:24.571223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-1d9a5214-5abb-4b2f-9421-2cbc58c86b17 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:24.572437 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-1d9a5214-5abb-4b2f-9421-2cbc58c86b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:24.636198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1324/2610] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:24.644683 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444b79b-db9b-41b7-bc54-5572eee02399 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:24.644986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444b79b-db9b-41b7-bc54-5572eee02399 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:24.645270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444b79b-db9b-41b7-bc54-5572eee02399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:24.665437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3444b79b-db9b-41b7-bc54-5572eee02399 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:24.666630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3444b79b-db9b-41b7-bc54-5572eee02399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:24.675393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1287/2611] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:24.679633 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a5214-5abb-4b2f-9421-2cbc58c86b17 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:24.690071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a5214-5abb-4b2f-9421-2cbc58c86b17 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:24.695838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ba43-3cb9-4211-9ea9-4bf3b0be6c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:24.696503 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ba43-3cb9-4211-9ea9-4bf3b0be6c76 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:24.696780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ba43-3cb9-4211-9ea9-4bf3b0be6c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:24.697064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6ba43-3cb9-4211-9ea9-4bf3b0be6c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:24.697733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ba43-3cb9-4211-9ea9-4bf3b0be6c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:16:24.698033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ba43-3cb9-4211-9ea9-4bf3b0be6c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:24.699748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6ba43-3cb9-4211-9ea9-4bf3b0be6c76 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:24.712112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1325/2612] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:16:24.716790 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444b79b-db9b-41b7-bc54-5572eee02399 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:24.726134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444b79b-db9b-41b7-bc54-5572eee02399 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:24.731335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa3186-e5ff-4e68-b7c1-50efaeba2f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:24.731931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa3186-e5ff-4e68-b7c1-50efaeba2f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:24.732210 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa3186-e5ff-4e68-b7c1-50efaeba2f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:24.732479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa3186-e5ff-4e68-b7c1-50efaeba2f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:24.733134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa3186-e5ff-4e68-b7c1-50efaeba2f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:24.735028 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa3186-e5ff-4e68-b7c1-50efaeba2f66 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:24.765635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1288/2613] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:16:24 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:24.769930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ba43-3cb9-4211-9ea9-4bf3b0be6c76 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:24.780150 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6ba43-3cb9-4211-9ea9-4bf3b0be6c76 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:24.822955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:24.838911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd4f34-63eb-4e3e-bc88-846a448c70d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:24.839520 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd4f34-63eb-4e3e-bc88-846a448c70d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:24.839797 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd4f34-63eb-4e3e-bc88-846a448c70d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:24.840067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd4f34-63eb-4e3e-bc88-846a448c70d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:24.840731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd4f34-63eb-4e3e-bc88-846a448c70d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:24.842721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd4f34-63eb-4e3e-bc88-846a448c70d7 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:24.864610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1326/2614] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:16:24 2022] POST /identity/v3/users => generated 281 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:16:24.869263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa3186-e5ff-4e68-b7c1-50efaeba2f66 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:24.880158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa3186-e5ff-4e68-b7c1-50efaeba2f66 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:24.885107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c373b5-af55-4140-bb8c-ca370cb60772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:24.885705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c373b5-af55-4140-bb8c-ca370cb60772 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:24.885984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c373b5-af55-4140-bb8c-ca370cb60772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:24.886304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c373b5-af55-4140-bb8c-ca370cb60772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:24.886895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c373b5-af55-4140-bb8c-ca370cb60772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:24.888601 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c373b5-af55-4140-bb8c-ca370cb60772 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:24.898423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1289/2615] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:24.902377 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd4f34-63eb-4e3e-bc88-846a448c70d7 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:24.912507 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd4f34-63eb-4e3e-bc88-846a448c70d7 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:24.917420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51d472-8819-4a67-bb69-125ddccc6bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:24.918016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51d472-8819-4a67-bb69-125ddccc6bba admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:24.918315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51d472-8819-4a67-bb69-125ddccc6bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:24.918692 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51d472-8819-4a67-bb69-125ddccc6bba admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:24.919341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51d472-8819-4a67-bb69-125ddccc6bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:24.920938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51d472-8819-4a67-bb69-125ddccc6bba admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:24.932326 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1327/2616] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:16:24.936537 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c373b5-af55-4140-bb8c-ca370cb60772 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:24.947521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c373b5-af55-4140-bb8c-ca370cb60772 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:24.953980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1950bcd-b836-450f-acc5-fe321230c6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:24.954710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950bcd-b836-450f-acc5-fe321230c6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:24.954989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950bcd-b836-450f-acc5-fe321230c6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:24.955261 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950bcd-b836-450f-acc5-fe321230c6b2 admin admin] PATH_INFO: `/v3/projects/f48ad778b5ba40ecb2cea261378d82b8/users/1caeea9fbdaa4af98788aa434a4e9cd6/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:24.972679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1950bcd-b836-450f-acc5-fe321230c6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48ad778b5ba40ecb2cea261378d82b8, user_id=1caeea9fbdaa4af98788aa434a4e9cd6, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:24.975616 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1950bcd-b836-450f-acc5-fe321230c6b2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:24.992643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1290/2617] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:16:24 2022] PUT /identity/v3/projects/f48ad778b5ba40ecb2cea261378d82b8/users/1caeea9fbdaa4af98788aa434a4e9cd6/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:25.005848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace960bd-6789-49b7-9b1f-a43555d5066a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:25.006134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace960bd-6789-49b7-9b1f-a43555d5066a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:25.006401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace960bd-6789-49b7-9b1f-a43555d5066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:25.035134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ace960bd-6789-49b7-9b1f-a43555d5066a None None] MFA Rules not processed for user `1caeea9fbdaa4af98788aa434a4e9cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:25.036354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ace960bd-6789-49b7-9b1f-a43555d5066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:25.107213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1328/2618] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:25.145129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1950bcd-b836-450f-acc5-fe321230c6b2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:25.147068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f1950bcd-b836-450f-acc5-fe321230c6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:25.162133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:25.208700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1950bcd-b836-450f-acc5-fe321230c6b2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:25.212998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94885c-b1fd-4221-b667-44d2d7941627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:25.213643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94885c-b1fd-4221-b667-44d2d7941627 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:25.213924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94885c-b1fd-4221-b667-44d2d7941627 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:25.214195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94885c-b1fd-4221-b667-44d2d7941627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:25.222894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94885c-b1fd-4221-b667-44d2d7941627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:25.224348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94885c-b1fd-4221-b667-44d2d7941627 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:25.233244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1291/2619] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:25.250570 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace960bd-6789-49b7-9b1f-a43555d5066a None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:25.316984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace960bd-6789-49b7-9b1f-a43555d5066a None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:25.322138 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:25.322791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:25.323074 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:25.323344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] PATH_INFO: `/v3/users/1caeea9fbdaa4af98788aa434a4e9cd6` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:25.324528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1caeea9fbdaa4af98788aa434a4e9cd6)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:25.326543 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:25.377894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1caeea9fbdaa4af98788aa434a4e9cd6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:25.378678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1caeea9fbdaa4af98788aa434a4e9cd6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:25.386505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:25.396255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1caeea9fbdaa4af98788aa434a4e9cd6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:25.405247 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1caeea9fbdaa4af98788aa434a4e9cd6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:25.406187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1caeea9fbdaa4af98788aa434a4e9cd6'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:25.420344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1329/2620] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:25 2022] DELETE /identity/v3/users/1caeea9fbdaa4af98788aa434a4e9cd6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:25.424691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5bd0b-2996-446d-b4b2-4cd21f3eadb3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:25.424991 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5bd0b-2996-446d-b4b2-4cd21f3eadb3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:25.425291 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5bd0b-2996-446d-b4b2-4cd21f3eadb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:25.444886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d3e5bd0b-2996-446d-b4b2-4cd21f3eadb3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:25.446141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d3e5bd0b-2996-446d-b4b2-4cd21f3eadb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:25.508406 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1292/2621] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:25.519858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:25.521537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:25.583070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658513aa-f6e6-4aaf-b81f-6833c877a9ee admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:25.587123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900868c-33a3-447f-9b57-4e1822891654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:25.587739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900868c-33a3-447f-9b57-4e1822891654 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:25.588022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900868c-33a3-447f-9b57-4e1822891654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:25.588291 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900868c-33a3-447f-9b57-4e1822891654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:25.597567 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900868c-33a3-447f-9b57-4e1822891654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:25.599047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900868c-33a3-447f-9b57-4e1822891654 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:25.608707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1330/2622] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:25.897585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5bd0b-2996-446d-b4b2-4cd21f3eadb3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:25.899156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d3e5bd0b-2996-446d-b4b2-4cd21f3eadb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:25.912227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5bd0b-2996-446d-b4b2-4cd21f3eadb3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:25.918002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:25.918648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:25.918927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:25.919198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] PATH_INFO: `/v3/projects/f48ad778b5ba40ecb2cea261378d82b8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:25.920340 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48ad778b5ba40ecb2cea261378d82b8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:25.922337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:25.970975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48ad778b5ba40ecb2cea261378d82b8', 'request_id': 'req-fee81d17-2fb2-4375-b437-2a96dd5099f1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:25.977266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48ad778b5ba40ecb2cea261378d82b8', 'request_id': 'req-fee81d17-2fb2-4375-b437-2a96dd5099f1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:25.986017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48ad778b5ba40ecb2cea261378d82b8', 'request_id': 'req-fee81d17-2fb2-4375-b437-2a96dd5099f1'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:25.997839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] The token cache is being invalidate because project f48ad778b5ba40ecb2cea261378d82b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:25.998133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:25.998856 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fee81d17-2fb2-4375-b437-2a96dd5099f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:26.000831 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1293/2623] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:25 2022] DELETE /identity/v3/projects/f48ad778b5ba40ecb2cea261378d82b8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:26.005856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456aaed-5be0-4b5d-8ca1-e204db06b5c6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:26.006363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456aaed-5be0-4b5d-8ca1-e204db06b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:26.006475 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456aaed-5be0-4b5d-8ca1-e204db06b5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:26.028651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f456aaed-5be0-4b5d-8ca1-e204db06b5c6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:26.029913 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f456aaed-5be0-4b5d-8ca1-e204db06b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:26.095020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1331/2624] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:26.103496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d49fd-553f-4da8-9a69-dcd145fc5296 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:26.103788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d49fd-553f-4da8-9a69-dcd145fc5296 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:26.104061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d49fd-553f-4da8-9a69-dcd145fc5296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:26.135472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-005d49fd-553f-4da8-9a69-dcd145fc5296 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:26.136698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-005d49fd-553f-4da8-9a69-dcd145fc5296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:26.146018 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1294/2625] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:26.150486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456aaed-5be0-4b5d-8ca1-e204db06b5c6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:26.161294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456aaed-5be0-4b5d-8ca1-e204db06b5c6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:26.167206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b9143-0efa-4e04-859c-0395895c3ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:26.167819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b9143-0efa-4e04-859c-0395895c3ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:26.168100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b9143-0efa-4e04-859c-0395895c3ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:26.168376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b9143-0efa-4e04-859c-0395895c3ca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:26.169190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b9143-0efa-4e04-859c-0395895c3ca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:16:26.169518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b9143-0efa-4e04-859c-0395895c3ca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:26.171140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b9143-0efa-4e04-859c-0395895c3ca8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:26.183479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1332/2626] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 17:16:26.188012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d49fd-553f-4da8-9a69-dcd145fc5296 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:26.197471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d49fd-553f-4da8-9a69-dcd145fc5296 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:26.202990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beff774-6d65-45ad-babd-3b30c2b12f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:26.203612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beff774-6d65-45ad-babd-3b30c2b12f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:26.203884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beff774-6d65-45ad-babd-3b30c2b12f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:26.204162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beff774-6d65-45ad-babd-3b30c2b12f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:26.204815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beff774-6d65-45ad-babd-3b30c2b12f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:26.206782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beff774-6d65-45ad-babd-3b30c2b12f91 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:26.253337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1295/2627] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:16:26 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:16:26.257904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b9143-0efa-4e04-859c-0395895c3ca8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:26.268785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b9143-0efa-4e04-859c-0395895c3ca8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:26.327110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6733b-147a-488f-9427-59c95125a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:26.327714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6733b-147a-488f-9427-59c95125a2ee admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:26.327995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6733b-147a-488f-9427-59c95125a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:26.328271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6733b-147a-488f-9427-59c95125a2ee admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:26.328902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6733b-147a-488f-9427-59c95125a2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:26.330840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6733b-147a-488f-9427-59c95125a2ee admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:26.339771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:26.356554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1333/2628] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:16:26 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:16:26.357822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beff774-6d65-45ad-babd-3b30c2b12f91 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:26.368401 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beff774-6d65-45ad-babd-3b30c2b12f91 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:26.373879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c7b3-f4e5-40fc-aa7b-14b4142a381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:26.374482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c7b3-f4e5-40fc-aa7b-14b4142a381c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:26.374764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c7b3-f4e5-40fc-aa7b-14b4142a381c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:26.375387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c7b3-f4e5-40fc-aa7b-14b4142a381c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:26.376039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26c7b3-f4e5-40fc-aa7b-14b4142a381c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:26.377684 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26c7b3-f4e5-40fc-aa7b-14b4142a381c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:26.379920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:26.389318 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1296/2629] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:26.393334 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6733b-147a-488f-9427-59c95125a2ee admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:26.403777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6733b-147a-488f-9427-59c95125a2ee admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:26.409356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70586714-5687-4c18-8369-c186f577cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:26.409956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586714-5687-4c18-8369-c186f577cfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:26.410242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586714-5687-4c18-8369-c186f577cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:26.410516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70586714-5687-4c18-8369-c186f577cfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:26.411160 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586714-5687-4c18-8369-c186f577cfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:26.412762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70586714-5687-4c18-8369-c186f577cfa4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:26.423910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1334/2630] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:16:26.428094 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c7b3-f4e5-40fc-aa7b-14b4142a381c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:26.438606 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c7b3-f4e5-40fc-aa7b-14b4142a381c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:26.443789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b73f4-a51a-40e6-bd6e-67439d1d322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:26.444442 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b73f4-a51a-40e6-bd6e-67439d1d322e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:26.444700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b73f4-a51a-40e6-bd6e-67439d1d322e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:26.444975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b73f4-a51a-40e6-bd6e-67439d1d322e admin admin] PATH_INFO: `/v3/projects/4ff6b43229454df7834fdb528e0ccea5/users/b7d00ee76a4246d9abcf430aa06a599a/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:26.459776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b73f4-a51a-40e6-bd6e-67439d1d322e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff6b43229454df7834fdb528e0ccea5, user_id=b7d00ee76a4246d9abcf430aa06a599a, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:26.462486 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b73f4-a51a-40e6-bd6e-67439d1d322e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:26.476407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1297/2631] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:16:26 2022] PUT /identity/v3/projects/4ff6b43229454df7834fdb528e0ccea5/users/b7d00ee76a4246d9abcf430aa06a599a/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:16:26.486889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ef97-9f87-4885-9704-e3aa1832437c None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:26.487180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ef97-9f87-4885-9704-e3aa1832437c None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:26.487456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ef97-9f87-4885-9704-e3aa1832437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:26.527769 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8ee0ef97-9f87-4885-9704-e3aa1832437c None None] MFA Rules not processed for user `b7d00ee76a4246d9abcf430aa06a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:26.529561 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8ee0ef97-9f87-4885-9704-e3aa1832437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:26.610805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1335/2632] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:16:26.622631 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b73f4-a51a-40e6-bd6e-67439d1d322e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:26.624480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-190b73f4-a51a-40e6-bd6e-67439d1d322e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:26.683134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b73f4-a51a-40e6-bd6e-67439d1d322e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:26.687119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e220a9e-aec8-468d-9a3e-0f7f985cb48c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:26.687713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e220a9e-aec8-468d-9a3e-0f7f985cb48c service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:26.687987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e220a9e-aec8-468d-9a3e-0f7f985cb48c service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:26.688253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e220a9e-aec8-468d-9a3e-0f7f985cb48c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:26.696535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e220a9e-aec8-468d-9a3e-0f7f985cb48c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:26.697998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e220a9e-aec8-468d-9a3e-0f7f985cb48c service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:26.706539 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1298/2633] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:28.089346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f4994-17c1-492f-a526-27a2d7970aa0 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:28.089936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f4994-17c1-492f-a526-27a2d7970aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:28.089936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f4994-17c1-492f-a526-27a2d7970aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:28.110031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-aa0f4994-17c1-492f-a526-27a2d7970aa0 None None] MFA Rules not processed for user `b7d00ee76a4246d9abcf430aa06a599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:28.111261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aa0f4994-17c1-492f-a526-27a2d7970aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:28.119910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1336/2634] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:36.702758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:38.104581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:INSERT=2,keystone:SELECT=42 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:44.310713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c19a-8506-407b-bd13-495a076f4024 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:44.311274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c19a-8506-407b-bd13-495a076f4024 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:44.311274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13c19a-8506-407b-bd13-495a076f4024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:44.335137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ea13c19a-8506-407b-bd13-495a076f4024 None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:44.336366 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ea13c19a-8506-407b-bd13-495a076f4024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:44.396844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1299/2635] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:16:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:44.409225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f4994-17c1-492f-a526-27a2d7970aa0 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:44.410823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-aa0f4994-17c1-492f-a526-27a2d7970aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:44.479856 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f4994-17c1-492f-a526-27a2d7970aa0 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:44.484891 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2d8dd-b736-4daf-84fd-d26c87eb251d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:44.485537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2d8dd-b736-4daf-84fd-d26c87eb251d service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:44.485819 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2d8dd-b736-4daf-84fd-d26c87eb251d service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:44.486093 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2d8dd-b736-4daf-84fd-d26c87eb251d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:44.494639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2d8dd-b736-4daf-84fd-d26c87eb251d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:44.496229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2d8dd-b736-4daf-84fd-d26c87eb251d service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:44.505244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1337/2636] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:16:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:16:45.045490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cfa93-c219-4d2c-beb9-0550835736c3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:45.045775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cfa93-c219-4d2c-beb9-0550835736c3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:45.046047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cfa93-c219-4d2c-beb9-0550835736c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:45.065671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6b4cfa93-c219-4d2c-beb9-0550835736c3 None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:45.066986 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6b4cfa93-c219-4d2c-beb9-0550835736c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:45.074549 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1300/2637] 10.222.0.76 () {58 vars in 967 bytes} [Mon Sep 19 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:16:45.088021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2d8dd-b736-4daf-84fd-d26c87eb251d service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:45.098877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2d8dd-b736-4daf-84fd-d26c87eb251d service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:45.104881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d28d5d-edcf-4d98-a052-3aa088ab8453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:45.105576 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d28d5d-edcf-4d98-a052-3aa088ab8453 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:45.105838 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d28d5d-edcf-4d98-a052-3aa088ab8453 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:45.106109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d28d5d-edcf-4d98-a052-3aa088ab8453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:45.114420 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d28d5d-edcf-4d98-a052-3aa088ab8453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:45.115994 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d28d5d-edcf-4d98-a052-3aa088ab8453 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:45.124071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1338/2638] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:16:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:16:45.356776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c55875-8b5c-4eff-a2e6-fa62632f5e64 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:45.357330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c55875-8b5c-4eff-a2e6-fa62632f5e64 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:45.357330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c55875-8b5c-4eff-a2e6-fa62632f5e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:45.379423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-31c55875-8b5c-4eff-a2e6-fa62632f5e64 None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:45.380650 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-31c55875-8b5c-4eff-a2e6-fa62632f5e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:45.389166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1301/2639] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:45.411073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d28d5d-edcf-4d98-a052-3aa088ab8453 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:45.422050 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d28d5d-edcf-4d98-a052-3aa088ab8453 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:45.429712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37591b0e-e129-40a1-8075-c1a4e14a59e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:45.430529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37591b0e-e129-40a1-8075-c1a4e14a59e4 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:45.430815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37591b0e-e129-40a1-8075-c1a4e14a59e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:45.433176 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37591b0e-e129-40a1-8075-c1a4e14a59e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:45.441932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37591b0e-e129-40a1-8075-c1a4e14a59e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:45.443535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37591b0e-e129-40a1-8075-c1a4e14a59e4 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:45.452818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1339/2640] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:16:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 17:16:45.785479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df8779-bb80-440f-ac2e-13366d0c21ee None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:45.785766 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df8779-bb80-440f-ac2e-13366d0c21ee None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:45.786053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df8779-bb80-440f-ac2e-13366d0c21ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:45.806534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-04df8779-bb80-440f-ac2e-13366d0c21ee None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:45.808363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-04df8779-bb80-440f-ac2e-13366d0c21ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:45.817402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1302/2641] 10.222.0.76 () {58 vars in 967 bytes} [Mon Sep 19 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:45.832457 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37591b0e-e129-40a1-8075-c1a4e14a59e4 service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:45.846119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37591b0e-e129-40a1-8075-c1a4e14a59e4 service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:45.852432 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2df1c0-a905-46ef-8d1a-c9f979e268a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:45.853075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2df1c0-a905-46ef-8d1a-c9f979e268a2 service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:45.853371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2df1c0-a905-46ef-8d1a-c9f979e268a2 service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:45.853785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2df1c0-a905-46ef-8d1a-c9f979e268a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:45.863928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2df1c0-a905-46ef-8d1a-c9f979e268a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:45.865668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2df1c0-a905-46ef-8d1a-c9f979e268a2 service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:45.878078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1340/2642] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:16:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:16:48.071936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df8779-bb80-440f-ac2e-13366d0c21ee None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:48.141153 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df8779-bb80-440f-ac2e-13366d0c21ee None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:48.145761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:48.146432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:48.146714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:48.146993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] PATH_INFO: `/v3/users/b7d00ee76a4246d9abcf430aa06a599a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:48.148148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d00ee76a4246d9abcf430aa06a599a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:48.150149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:48.201341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d00ee76a4246d9abcf430aa06a599a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:48.209545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d00ee76a4246d9abcf430aa06a599a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:48.210258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d00ee76a4246d9abcf430aa06a599a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:48.218573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d00ee76a4246d9abcf430aa06a599a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:48.219226 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d00ee76a4246d9abcf430aa06a599a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:48.238216 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1303/2643] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:48 2022] DELETE /identity/v3/users/b7d00ee76a4246d9abcf430aa06a599a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:48.242873 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e445-5daa-4616-8565-7757716ca663 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:48.243354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e445-5daa-4616-8565-7757716ca663 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:48.243651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2e445-5daa-4616-8565-7757716ca663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:48.264204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cae2e445-5daa-4616-8565-7757716ca663 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:16:48.265466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cae2e445-5daa-4616-8565-7757716ca663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:48.328833 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1341/2644] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:16:48.338814 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:48.340267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:48.347483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:48.412995 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add1bf9-5ae8-46d4-b67a-bed34a47d4dd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:48.419266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f69fa-ccb7-4930-8496-e3a1a9ce8f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:48.420010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f69fa-ccb7-4930-8496-e3a1a9ce8f16 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:48.420293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f69fa-ccb7-4930-8496-e3a1a9ce8f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:48.420627 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f69fa-ccb7-4930-8496-e3a1a9ce8f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:48.431803 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f69fa-ccb7-4930-8496-e3a1a9ce8f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:48.433617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f69fa-ccb7-4930-8496-e3a1a9ce8f16 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:48.448445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1304/2645] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:48.641552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2e445-5daa-4616-8565-7757716ca663 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:48.643188 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cae2e445-5daa-4616-8565-7757716ca663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:48.655626 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2e445-5daa-4616-8565-7757716ca663 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:48.661620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:48.662342 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:48.662689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:48.663046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] PATH_INFO: `/v3/projects/4ff6b43229454df7834fdb528e0ccea5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:48.664313 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff6b43229454df7834fdb528e0ccea5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:48.666434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:48.713345 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:48.716370 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff6b43229454df7834fdb528e0ccea5', 'request_id': 'req-bcb39854-5957-471a-8e0f-9c30161702bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:48.722949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff6b43229454df7834fdb528e0ccea5', 'request_id': 'req-bcb39854-5957-471a-8e0f-9c30161702bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:48.732280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff6b43229454df7834fdb528e0ccea5', 'request_id': 'req-bcb39854-5957-471a-8e0f-9c30161702bd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:48.743649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] The token cache is being invalidate because project 4ff6b43229454df7834fdb528e0ccea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:48.743930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:48.744561 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:48.746354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1342/2646] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:48 2022] DELETE /identity/v3/projects/4ff6b43229454df7834fdb528e0ccea5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:49.835309 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f69fa-ccb7-4930-8496-e3a1a9ce8f16 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:49.844168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f69fa-ccb7-4930-8496-e3a1a9ce8f16 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:49.894006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f96c9-65c2-4149-9923-18b6815cdaee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:49.894627 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f96c9-65c2-4149-9923-18b6815cdaee service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:49.894905 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f96c9-65c2-4149-9923-18b6815cdaee service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:49.895294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f96c9-65c2-4149-9923-18b6815cdaee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:49.897363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e42f96c9-65c2-4149-9923-18b6815cdaee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:49.960149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f96c9-65c2-4149-9923-18b6815cdaee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:49.961642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f96c9-65c2-4149-9923-18b6815cdaee service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:49.971403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1305/2647] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:53.617317 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:53.619807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:53.763854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb39854-5957-471a-8e0f-9c30161702bd admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:53.769271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7ba4c-1bbb-4c07-a62f-2041eaf7be5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4716f9539151414dadd9e4b8f13ffc0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:53.770028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ba4c-1bbb-4c07-a62f-2041eaf7be5a service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:53.770376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ba4c-1bbb-4c07-a62f-2041eaf7be5a service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:53.770711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7ba4c-1bbb-4c07-a62f-2041eaf7be5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:53.772917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0bf7ba4c-1bbb-4c07-a62f-2041eaf7be5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:53.786639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7ba4c-1bbb-4c07-a62f-2041eaf7be5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:53.788493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7ba4c-1bbb-4c07-a62f-2041eaf7be5a service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:53.805016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1343/2648] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:57.006306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f96c9-65c2-4149-9923-18b6815cdaee service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:57.007860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e42f96c9-65c2-4149-9923-18b6815cdaee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:57.022911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f96c9-65c2-4149-9923-18b6815cdaee service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:57.027665 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:57.028311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:57.028593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:57.028866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] PATH_INFO: `/v3/users/c6e85017753e4a87a560cb384bea179b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:57.030112 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e85017753e4a87a560cb384bea179b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:57.032174 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:57.084156 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e85017753e4a87a560cb384bea179b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.089004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:57.092244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e85017753e4a87a560cb384bea179b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.093263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e85017753e4a87a560cb384bea179b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.104984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e85017753e4a87a560cb384bea179b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.105715 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e85017753e4a87a560cb384bea179b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.123398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1306/2649] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:57 2022] DELETE /identity/v3/users/c6e85017753e4a87a560cb384bea179b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:16:57.302990 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7ba4c-1bbb-4c07-a62f-2041eaf7be5a service placement] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:57.315260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7ba4c-1bbb-4c07-a62f-2041eaf7be5a service placement] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:57.384804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:57.385565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:57.385974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:57.386312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] PATH_INFO: `/v3/projects/119fb3b5ff1a4ccda4824dbf26dfb7e3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:57.387539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119fb3b5ff1a4ccda4824dbf26dfb7e3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:57.390207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:57.459355 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119fb3b5ff1a4ccda4824dbf26dfb7e3', 'request_id': 'req-db30a80e-5957-4261-afd6-db96736f6360'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.470357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119fb3b5ff1a4ccda4824dbf26dfb7e3', 'request_id': 'req-db30a80e-5957-4261-afd6-db96736f6360'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.480143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119fb3b5ff1a4ccda4824dbf26dfb7e3', 'request_id': 'req-db30a80e-5957-4261-afd6-db96736f6360'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.481528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:57.495064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] The token cache is being invalidate because project 119fb3b5ff1a4ccda4824dbf26dfb7e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:57.495356 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.496003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.497539 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1344/2650] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:57 2022] DELETE /identity/v3/projects/119fb3b5ff1a4ccda4824dbf26dfb7e3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:16:57.502039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:57.503519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:57.516704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d25f19-71b7-4768-bec8-5b1f9ec5cb31 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:57.584274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:57.584907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:57.585100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:57.585375 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] PATH_INFO: `/v3/users/f317e7a06b574eacac30f2f9f5579277` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:57.586640 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f317e7a06b574eacac30f2f9f5579277)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:57.588476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:57.644107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f317e7a06b574eacac30f2f9f5579277'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.653868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f317e7a06b574eacac30f2f9f5579277'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.654744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f317e7a06b574eacac30f2f9f5579277'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.663795 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f317e7a06b574eacac30f2f9f5579277'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.664518 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f317e7a06b574eacac30f2f9f5579277'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:57.689673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1307/2651] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:16:57 2022] DELETE /identity/v3/users/f317e7a06b574eacac30f2f9f5579277 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:16:57.732368 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:57.734020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:57.794892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30a80e-5957-4261-afd6-db96736f6360 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:57.847354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c348d46-c8d2-498d-ac7e-c2f8b74f5a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:57.847977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348d46-c8d2-498d-ac7e-c2f8b74f5a8b service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:57.848255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348d46-c8d2-498d-ac7e-c2f8b74f5a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:57.848532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c348d46-c8d2-498d-ac7e-c2f8b74f5a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:57.850318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-7c348d46-c8d2-498d-ac7e-c2f8b74f5a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:57.884570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:16:57.887077 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:16:57.920661 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c348d46-c8d2-498d-ac7e-c2f8b74f5a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:57.922243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c348d46-c8d2-498d-ac7e-c2f8b74f5a8b service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:57.932226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1345/2652] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:16:57.953450 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:16:57.973764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1cdf3-3574-417e-b6bb-835cb53ef5e5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:16:57.979418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:16:57.980467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:16:57.980842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:16:57.981224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] PATH_INFO: `/v3/projects/1019050339b54b87be45e3c28534942f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:16:57.982454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1019050339b54b87be45e3c28534942f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:16:57.985073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:16:58.039108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1019050339b54b87be45e3c28534942f', 'request_id': 'req-0741b93a-d8c5-4699-868e-3228b32cd851'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:58.044849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1019050339b54b87be45e3c28534942f', 'request_id': 'req-0741b93a-d8c5-4699-868e-3228b32cd851'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:58.054180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1019050339b54b87be45e3c28534942f', 'request_id': 'req-0741b93a-d8c5-4699-868e-3228b32cd851'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:58.066214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] The token cache is being invalidate because project 1019050339b54b87be45e3c28534942f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:16:58.066508 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:58.067178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:16:58.069001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1308/2653] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:16:57 2022] DELETE /identity/v3/projects/1019050339b54b87be45e3c28534942f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:17:00.456012 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f610f-f9a8-470c-accb-2106ac49f700 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:00.456548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f610f-f9a8-470c-accb-2106ac49f700 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:00.456681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f610f-f9a8-470c-accb-2106ac49f700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:00.477535 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-9f3f610f-f9a8-470c-accb-2106ac49f700 None None] MFA Rules not processed for user `d2cd08c0e3194e4cbb60925fa1332ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:00.478695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9f3f610f-f9a8-470c-accb-2106ac49f700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:00.545249 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1346/2654] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:01.619692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:01.621244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:01.695764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741b93a-d8c5-4699-868e-3228b32cd851 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:01.700957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:01.701642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:01.701925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:01.702198 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] PATH_INFO: `/v3/users/ca12607363574ef0a0a721533e676824` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:01.703347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca12607363574ef0a0a721533e676824)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:01.705345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:01.761117 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca12607363574ef0a0a721533e676824'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:01.768832 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca12607363574ef0a0a721533e676824'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:01.769931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca12607363574ef0a0a721533e676824'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:01.777660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca12607363574ef0a0a721533e676824'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:01.778368 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-183feace-f3b6-4216-8dbb-e0d93327fc6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca12607363574ef0a0a721533e676824'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:01.792642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:01.803891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1309/2655] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:01 2022] DELETE /identity/v3/users/ca12607363574ef0a0a721533e676824 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:01.980658 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f610f-f9a8-470c-accb-2106ac49f700 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:01.993371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=100 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:02.007028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f610f-f9a8-470c-accb-2106ac49f700 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:02.071366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:02.072016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.072318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.072591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] PATH_INFO: `/v3/projects/a07a664acf7a40cab34f30ee9ab43c61` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.073729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07a664acf7a40cab34f30ee9ab43c61)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:02.075646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:02.123378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07a664acf7a40cab34f30ee9ab43c61', 'request_id': 'req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:02.129813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07a664acf7a40cab34f30ee9ab43c61', 'request_id': 'req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:02.139082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07a664acf7a40cab34f30ee9ab43c61', 'request_id': 'req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:02.151199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] The token cache is being invalidate because project a07a664acf7a40cab34f30ee9ab43c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:02.151490 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:02.152147 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-867bc2cb-8b8a-4385-81b2-33b7b69e10d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:02.153908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1347/2656] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:01 2022] DELETE /identity/v3/projects/a07a664acf7a40cab34f30ee9ab43c61 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:02.158812 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4bfdf-142a-41d4-a791-243b8637fa92 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.159095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4bfdf-142a-41d4-a791-243b8637fa92 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.159367 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4bfdf-142a-41d4-a791-243b8637fa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.180922 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-15e4bfdf-142a-41d4-a791-243b8637fa92 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:02.182187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-15e4bfdf-142a-41d4-a791-243b8637fa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:02.243444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1310/2657] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:02.252238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b71eb-61e9-4ccb-8413-da389ad2feaa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.252531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b71eb-61e9-4ccb-8413-da389ad2feaa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.252804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b71eb-61e9-4ccb-8413-da389ad2feaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.273316 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-672b71eb-61e9-4ccb-8413-da389ad2feaa None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:02.274540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-672b71eb-61e9-4ccb-8413-da389ad2feaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:02.283906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1348/2658] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:02.288276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4bfdf-142a-41d4-a791-243b8637fa92 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:02.298771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4bfdf-142a-41d4-a791-243b8637fa92 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:02.304589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78da449-bbfc-4a22-809e-b7896d05b76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:02.305253 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78da449-bbfc-4a22-809e-b7896d05b76a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.305531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78da449-bbfc-4a22-809e-b7896d05b76a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.305800 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78da449-bbfc-4a22-809e-b7896d05b76a admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.306520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78da449-bbfc-4a22-809e-b7896d05b76a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:17:02.306827 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78da449-bbfc-4a22-809e-b7896d05b76a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:02.308437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78da449-bbfc-4a22-809e-b7896d05b76a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:02.321352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1311/2659] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:17:02.325916 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b71eb-61e9-4ccb-8413-da389ad2feaa None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:02.337104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b71eb-61e9-4ccb-8413-da389ad2feaa None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:02.343284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683eb8-6358-4bee-8a96-2fb6df0a9c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:02.343935 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683eb8-6358-4bee-8a96-2fb6df0a9c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.344233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683eb8-6358-4bee-8a96-2fb6df0a9c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.344487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77683eb8-6358-4bee-8a96-2fb6df0a9c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.345286 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77683eb8-6358-4bee-8a96-2fb6df0a9c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:02.347321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77683eb8-6358-4bee-8a96-2fb6df0a9c7a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:02.383295 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1349/2660] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:02 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:17:02.387527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78da449-bbfc-4a22-809e-b7896d05b76a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:02.398735 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78da449-bbfc-4a22-809e-b7896d05b76a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:02.470540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994c64-063e-4cd9-9261-fcba3e1290d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:02.471422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994c64-063e-4cd9-9261-fcba3e1290d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.471700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994c64-063e-4cd9-9261-fcba3e1290d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.471973 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994c64-063e-4cd9-9261-fcba3e1290d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.473142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74994c64-063e-4cd9-9261-fcba3e1290d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:02.475926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74994c64-063e-4cd9-9261-fcba3e1290d1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:02.505709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1312/2661] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:02 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:02.509834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683eb8-6358-4bee-8a96-2fb6df0a9c7a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:02.522332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77683eb8-6358-4bee-8a96-2fb6df0a9c7a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:02.528809 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a353b-1ed8-410b-9afc-623e0d78756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:02.529828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a353b-1ed8-410b-9afc-623e0d78756b admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.529828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a353b-1ed8-410b-9afc-623e0d78756b admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.530039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a353b-1ed8-410b-9afc-623e0d78756b admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.530658 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a353b-1ed8-410b-9afc-623e0d78756b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:02.532399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a353b-1ed8-410b-9afc-623e0d78756b admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:02.543975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1350/2662] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:17:02.548453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994c64-063e-4cd9-9261-fcba3e1290d1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:02.559541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994c64-063e-4cd9-9261-fcba3e1290d1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:02.565226 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a444244-74ff-4c47-811a-f81dad1e85fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:02.565857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444244-74ff-4c47-811a-f81dad1e85fb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.566137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444244-74ff-4c47-811a-f81dad1e85fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.566413 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a444244-74ff-4c47-811a-f81dad1e85fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.567303 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a444244-74ff-4c47-811a-f81dad1e85fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:02.568930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a444244-74ff-4c47-811a-f81dad1e85fb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:02.580843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1313/2663] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:02.597986 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a353b-1ed8-410b-9afc-623e0d78756b admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:02.610979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a353b-1ed8-410b-9afc-623e0d78756b admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:02.616151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98c090-18df-4ed5-aa75-78a1d45ec3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:02.616824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98c090-18df-4ed5-aa75-78a1d45ec3a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.617143 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98c090-18df-4ed5-aa75-78a1d45ec3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.617569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98c090-18df-4ed5-aa75-78a1d45ec3a1 admin admin] PATH_INFO: `/v3/projects/ed9c77a8da5144fc9da88485b6cf4cf9/users/4e32a048152943648101b83a6569c4b4/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.641235 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98c090-18df-4ed5-aa75-78a1d45ec3a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9c77a8da5144fc9da88485b6cf4cf9, user_id=4e32a048152943648101b83a6569c4b4, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:02.644684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98c090-18df-4ed5-aa75-78a1d45ec3a1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:02.660401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1351/2664] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:02 2022] PUT /identity/v3/projects/ed9c77a8da5144fc9da88485b6cf4cf9/users/4e32a048152943648101b83a6569c4b4/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:02.671082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aec26-a945-42ab-a979-6344d64d9e1b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.671589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aec26-a945-42ab-a979-6344d64d9e1b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.671700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8aec26-a945-42ab-a979-6344d64d9e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.700050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0a8aec26-a945-42ab-a979-6344d64d9e1b None None] MFA Rules not processed for user `4e32a048152943648101b83a6569c4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:02.701325 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0a8aec26-a945-42ab-a979-6344d64d9e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:02.759708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:02.772998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1314/2665] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:02.781591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98c090-18df-4ed5-aa75-78a1d45ec3a1 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:02.783541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9c98c090-18df-4ed5-aa75-78a1d45ec3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:02.820755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:02.864607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98c090-18df-4ed5-aa75-78a1d45ec3a1 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:02.871011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0617b7-5630-45e6-8bb0-0e17e1c80ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea18c782ddf2469fa3d10a135fc34c37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:02.872360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0617b7-5630-45e6-8bb0-0e17e1c80ef4 service nova] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:02.872643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0617b7-5630-45e6-8bb0-0e17e1c80ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:02.872911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0617b7-5630-45e6-8bb0-0e17e1c80ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:02.881904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0617b7-5630-45e6-8bb0-0e17e1c80ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:02.883488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0617b7-5630-45e6-8bb0-0e17e1c80ef4 service nova] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:02.893659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1352/2666] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:03.115901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8aec26-a945-42ab-a979-6344d64d9e1b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:03.187782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8aec26-a945-42ab-a979-6344d64d9e1b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:03.192652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:03.193332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:03.193612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:03.193886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] PATH_INFO: `/v3/users/4e32a048152943648101b83a6569c4b4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:03.195031 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e32a048152943648101b83a6569c4b4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:03.197021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:03.249827 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e32a048152943648101b83a6569c4b4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:03.258011 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e32a048152943648101b83a6569c4b4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:03.258780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e32a048152943648101b83a6569c4b4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:03.269839 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e32a048152943648101b83a6569c4b4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:03.270574 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e32a048152943648101b83a6569c4b4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:03.289346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1315/2667] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:03 2022] DELETE /identity/v3/users/4e32a048152943648101b83a6569c4b4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:03.294047 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82bec-8229-4006-88ff-8e280a3d99cb None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:03.294607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82bec-8229-4006-88ff-8e280a3d99cb None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:03.294729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff82bec-8229-4006-88ff-8e280a3d99cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:03.314557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-3ff82bec-8229-4006-88ff-8e280a3d99cb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:03.315848 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3ff82bec-8229-4006-88ff-8e280a3d99cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:03.379013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1353/2668] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:17:03.389023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:03.390528 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:03.453147 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8788979-7b5e-441a-b154-699d3a6347dc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:03.459343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31daf4-ba3e-4cb0-b55f-6265984ebb29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:03.459987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31daf4-ba3e-4cb0-b55f-6265984ebb29 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:03.460268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31daf4-ba3e-4cb0-b55f-6265984ebb29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:03.461126 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31daf4-ba3e-4cb0-b55f-6265984ebb29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:03.471590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31daf4-ba3e-4cb0-b55f-6265984ebb29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:03.473286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31daf4-ba3e-4cb0-b55f-6265984ebb29 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:03.485228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1316/2669] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:03.873242 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82bec-8229-4006-88ff-8e280a3d99cb None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:03.875520 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3ff82bec-8229-4006-88ff-8e280a3d99cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:03.889501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff82bec-8229-4006-88ff-8e280a3d99cb None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:03.895309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:03.895989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:03.896271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:03.896549 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] PATH_INFO: `/v3/projects/ed9c77a8da5144fc9da88485b6cf4cf9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:03.897863 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9c77a8da5144fc9da88485b6cf4cf9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:03.901847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:03.952244 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9c77a8da5144fc9da88485b6cf4cf9', 'request_id': 'req-abf97b79-9d55-44cf-8316-4e4a1b56a27a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:03.958045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9c77a8da5144fc9da88485b6cf4cf9', 'request_id': 'req-abf97b79-9d55-44cf-8316-4e4a1b56a27a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:03.966027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9c77a8da5144fc9da88485b6cf4cf9', 'request_id': 'req-abf97b79-9d55-44cf-8316-4e4a1b56a27a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:03.979256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] The token cache is being invalidate because project ed9c77a8da5144fc9da88485b6cf4cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:03.979748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:03.980503 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-abf97b79-9d55-44cf-8316-4e4a1b56a27a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:03.982641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1354/2670] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:03 2022] DELETE /identity/v3/projects/ed9c77a8da5144fc9da88485b6cf4cf9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:03.987523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea7767-b534-42fe-87a6-8c1fa1da85ea None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:03.988004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea7767-b534-42fe-87a6-8c1fa1da85ea None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:03.988151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea7767-b534-42fe-87a6-8c1fa1da85ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.009306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-eeea7767-b534-42fe-87a6-8c1fa1da85ea None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:04.010529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eeea7767-b534-42fe-87a6-8c1fa1da85ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:04.020548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:04.077051 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1317/2671] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:04.086634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e748cf-a8bf-4915-8aed-455e3447ebbc None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.086919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e748cf-a8bf-4915-8aed-455e3447ebbc None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.087359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e748cf-a8bf-4915-8aed-455e3447ebbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.107801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f6e748cf-a8bf-4915-8aed-455e3447ebbc None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:04.109023 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6e748cf-a8bf-4915-8aed-455e3447ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:04.117756 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1355/2672] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:04.121908 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea7767-b534-42fe-87a6-8c1fa1da85ea None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:04.136924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea7767-b534-42fe-87a6-8c1fa1da85ea None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:04.136924 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804397e0-d2e5-48e5-b117-dae25cf30bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:04.137465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804397e0-d2e5-48e5-b117-dae25cf30bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.137745 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804397e0-d2e5-48e5-b117-dae25cf30bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.138013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804397e0-d2e5-48e5-b117-dae25cf30bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.138674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804397e0-d2e5-48e5-b117-dae25cf30bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:17:04.138975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804397e0-d2e5-48e5-b117-dae25cf30bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:04.140894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804397e0-d2e5-48e5-b117-dae25cf30bc1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:04.159534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1318/2673] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:17:04.164159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e748cf-a8bf-4915-8aed-455e3447ebbc None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:04.174321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e748cf-a8bf-4915-8aed-455e3447ebbc None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:04.179268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac9e54-da82-45f9-9991-5e6aee1c1af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:04.179980 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9e54-da82-45f9-9991-5e6aee1c1af4 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.180344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9e54-da82-45f9-9991-5e6aee1c1af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.180702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac9e54-da82-45f9-9991-5e6aee1c1af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.181488 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac9e54-da82-45f9-9991-5e6aee1c1af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:04.183815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac9e54-da82-45f9-9991-5e6aee1c1af4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:04.225255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1356/2674] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:04 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:04.226472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804397e0-d2e5-48e5-b117-dae25cf30bc1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:04.241624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804397e0-d2e5-48e5-b117-dae25cf30bc1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:04.437277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdec77-b646-456f-a575-09ddfdd64c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:04.437891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdec77-b646-456f-a575-09ddfdd64c14 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.438166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdec77-b646-456f-a575-09ddfdd64c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.438430 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdec77-b646-456f-a575-09ddfdd64c14 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.439071 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdec77-b646-456f-a575-09ddfdd64c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:04.441013 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdec77-b646-456f-a575-09ddfdd64c14 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:04.464857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1319/2675] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:04 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:04.469155 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac9e54-da82-45f9-9991-5e6aee1c1af4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:04.480438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac9e54-da82-45f9-9991-5e6aee1c1af4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:04.486274 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a63e81-1050-4f69-9922-d48ec6113a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:04.487092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a63e81-1050-4f69-9922-d48ec6113a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.487453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a63e81-1050-4f69-9922-d48ec6113a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.487791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a63e81-1050-4f69-9922-d48ec6113a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.488517 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a63e81-1050-4f69-9922-d48ec6113a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:04.490250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a63e81-1050-4f69-9922-d48ec6113a3e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:04.496654 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:04.503569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1357/2676] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:04.507630 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdec77-b646-456f-a575-09ddfdd64c14 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:04.519089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdec77-b646-456f-a575-09ddfdd64c14 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:04.523749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09940b4-55ac-40ba-b200-ea7ca22b206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:04.524395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09940b4-55ac-40ba-b200-ea7ca22b206e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.524647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09940b4-55ac-40ba-b200-ea7ca22b206e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.524947 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09940b4-55ac-40ba-b200-ea7ca22b206e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.525643 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09940b4-55ac-40ba-b200-ea7ca22b206e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:04.527228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09940b4-55ac-40ba-b200-ea7ca22b206e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:04.538194 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1320/2677] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:04.542281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a63e81-1050-4f69-9922-d48ec6113a3e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:04.552597 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a63e81-1050-4f69-9922-d48ec6113a3e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:04.557489 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e70fa-f63b-4234-98e5-5388faabb391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:04.558245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e70fa-f63b-4234-98e5-5388faabb391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.558554 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e70fa-f63b-4234-98e5-5388faabb391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.558828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e70fa-f63b-4234-98e5-5388faabb391 admin admin] PATH_INFO: `/v3/projects/58bba03cd43642c4b613b5e5afb2b017/users/fef54aaac98a4adaa67e3e73733c780d/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.574546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e70fa-f63b-4234-98e5-5388faabb391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bba03cd43642c4b613b5e5afb2b017, user_id=fef54aaac98a4adaa67e3e73733c780d, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:04.577245 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e70fa-f63b-4234-98e5-5388faabb391 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:04.594088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1358/2678] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:04 2022] PUT /identity/v3/projects/58bba03cd43642c4b613b5e5afb2b017/users/fef54aaac98a4adaa67e3e73733c780d/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:17:04.604999 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4141a-c60c-4208-8e05-279468ad191f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.605320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4141a-c60c-4208-8e05-279468ad191f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.605593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4141a-c60c-4208-8e05-279468ad191f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.635138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0bd4141a-c60c-4208-8e05-279468ad191f None None] MFA Rules not processed for user `fef54aaac98a4adaa67e3e73733c780d`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:04.636319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0bd4141a-c60c-4208-8e05-279468ad191f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:04.705656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1321/2679] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:17:04.711364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e70fa-f63b-4234-98e5-5388faabb391 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:04.774996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e70fa-f63b-4234-98e5-5388faabb391 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:04.780096 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98346f3-ea4a-4d95-aaa0-165ed14979aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:04.780702 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98346f3-ea4a-4d95-aaa0-165ed14979aa admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.780974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98346f3-ea4a-4d95-aaa0-165ed14979aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.781257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98346f3-ea4a-4d95-aaa0-165ed14979aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.781884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98346f3-ea4a-4d95-aaa0-165ed14979aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:04.783882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98346f3-ea4a-4d95-aaa0-165ed14979aa admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:04.813712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1359/2680] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:04 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:04.818505 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4141a-c60c-4208-8e05-279468ad191f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:04.830250 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4141a-c60c-4208-8e05-279468ad191f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:04.839316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:04.890772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf6102-ed74-40cc-bd40-3c342d9c8cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:04.891314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6102-ed74-40cc-bd40-3c342d9c8cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.891600 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6102-ed74-40cc-bd40-3c342d9c8cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.891855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6102-ed74-40cc-bd40-3c342d9c8cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.892629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf6102-ed74-40cc-bd40-3c342d9c8cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:04.894802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf6102-ed74-40cc-bd40-3c342d9c8cb6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:04.917069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1322/2681] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:04 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:04.921062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98346f3-ea4a-4d95-aaa0-165ed14979aa admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:04.931777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98346f3-ea4a-4d95-aaa0-165ed14979aa admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:04.936701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb8e7-6b48-4fce-892e-ecdf9bcce256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:04.937349 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb8e7-6b48-4fce-892e-ecdf9bcce256 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.937599 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb8e7-6b48-4fce-892e-ecdf9bcce256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.937903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017eb8e7-6b48-4fce-892e-ecdf9bcce256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.938552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eb8e7-6b48-4fce-892e-ecdf9bcce256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:04.940344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017eb8e7-6b48-4fce-892e-ecdf9bcce256 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:04.951631 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1360/2682] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:04.956034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf6102-ed74-40cc-bd40-3c342d9c8cb6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:04.966217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf6102-ed74-40cc-bd40-3c342d9c8cb6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:04.970814 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa469-70e2-4e3f-9fa2-cee84c592337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:04.971496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa469-70e2-4e3f-9fa2-cee84c592337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:04.971776 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa469-70e2-4e3f-9fa2-cee84c592337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:04.972047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa469-70e2-4e3f-9fa2-cee84c592337 admin admin] PATH_INFO: `/v3/projects/056af5770e9f4d679197a4fef26979a7/users/f101016677dc410aaa66947d14316a42/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:04.988744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daa469-70e2-4e3f-9fa2-cee84c592337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056af5770e9f4d679197a4fef26979a7, user_id=f101016677dc410aaa66947d14316a42, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:04.991422 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daa469-70e2-4e3f-9fa2-cee84c592337 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:05.006453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1323/2683] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:04 2022] PUT /identity/v3/projects/056af5770e9f4d679197a4fef26979a7/users/f101016677dc410aaa66947d14316a42/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:17:05.010668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb8e7-6b48-4fce-892e-ecdf9bcce256 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:05.021659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017eb8e7-6b48-4fce-892e-ecdf9bcce256 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:05.080185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad40de-b012-4710-828c-8eee8a39dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:05.080985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad40de-b012-4710-828c-8eee8a39dbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:05.081307 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad40de-b012-4710-828c-8eee8a39dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:05.081581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad40de-b012-4710-828c-8eee8a39dbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:05.082224 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad40de-b012-4710-828c-8eee8a39dbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:05.083818 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad40de-b012-4710-828c-8eee8a39dbd3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:05.094199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1361/2684] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:05.100556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa469-70e2-4e3f-9fa2-cee84c592337 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:05.115004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa469-70e2-4e3f-9fa2-cee84c592337 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:05.120438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979ca4c-2149-444a-9e0f-6f71a5811f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:05.121110 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979ca4c-2149-444a-9e0f-6f71a5811f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:05.121389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979ca4c-2149-444a-9e0f-6f71a5811f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:05.121663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979ca4c-2149-444a-9e0f-6f71a5811f94 admin admin] PATH_INFO: `/v3/projects/056af5770e9f4d679197a4fef26979a7/users/f101016677dc410aaa66947d14316a42/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:05.123740 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979ca4c-2149-444a-9e0f-6f71a5811f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056af5770e9f4d679197a4fef26979a7, user_id=f101016677dc410aaa66947d14316a42, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:05.126772 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979ca4c-2149-444a-9e0f-6f71a5811f94 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:05.137979 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1324/2685] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:05 2022] PUT /identity/v3/projects/056af5770e9f4d679197a4fef26979a7/users/f101016677dc410aaa66947d14316a42/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:05.148642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb31923-582e-4979-93f9-b01603195cf2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:05.148816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb31923-582e-4979-93f9-b01603195cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:05.149151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb31923-582e-4979-93f9-b01603195cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:05.189795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-fdb31923-582e-4979-93f9-b01603195cf2 None None] MFA Rules not processed for user `f101016677dc410aaa66947d14316a42`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:05.191026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fdb31923-582e-4979-93f9-b01603195cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:05.226184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:05.272952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1362/2686] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:17:05.284770 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979ca4c-2149-444a-9e0f-6f71a5811f94 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:05.286663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2979ca4c-2149-444a-9e0f-6f71a5811f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:05.344572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979ca4c-2149-444a-9e0f-6f71a5811f94 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:05.348950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6d38f-488f-402f-aa69-8a2b65b96324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:05.349593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d38f-488f-402f-aa69-8a2b65b96324 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:05.349878 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d38f-488f-402f-aa69-8a2b65b96324 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:05.350149 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d38f-488f-402f-aa69-8a2b65b96324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:05.359811 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6d38f-488f-402f-aa69-8a2b65b96324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:05.361332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6d38f-488f-402f-aa69-8a2b65b96324 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:05.370668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1325/2687] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:05.453822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb31923-582e-4979-93f9-b01603195cf2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:05.464259 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb31923-582e-4979-93f9-b01603195cf2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:05.468318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb26ed-88d9-4534-9edf-bd474212607f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:05.468918 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb26ed-88d9-4534-9edf-bd474212607f service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:05.469228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb26ed-88d9-4534-9edf-bd474212607f service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:05.469791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb26ed-88d9-4534-9edf-bd474212607f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:05.539030 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb26ed-88d9-4534-9edf-bd474212607f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:05.540645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb26ed-88d9-4534-9edf-bd474212607f service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:05.550985 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1363/2688] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:12.492710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6d38f-488f-402f-aa69-8a2b65b96324 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:12.564494 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6d38f-488f-402f-aa69-8a2b65b96324 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:12.568927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:12.569594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:12.569850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:12.570268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] PATH_INFO: `/v3/users/fef54aaac98a4adaa67e3e73733c780d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:12.571477 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef54aaac98a4adaa67e3e73733c780d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:12.573177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:12.578965 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:12.629654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef54aaac98a4adaa67e3e73733c780d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:12.639010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef54aaac98a4adaa67e3e73733c780d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:12.639964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef54aaac98a4adaa67e3e73733c780d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:12.651860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef54aaac98a4adaa67e3e73733c780d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:12.652622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef54aaac98a4adaa67e3e73733c780d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:12.678921 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1326/2689] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:12 2022] DELETE /identity/v3/users/fef54aaac98a4adaa67e3e73733c780d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:17:12.683954 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e338d-b44f-4c1e-a7fb-229f87ce2906 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:12.684449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e338d-b44f-4c1e-a7fb-229f87ce2906 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:12.684588 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e338d-b44f-4c1e-a7fb-229f87ce2906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:12.704024 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-747e338d-b44f-4c1e-a7fb-229f87ce2906 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:12.705284 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-747e338d-b44f-4c1e-a7fb-229f87ce2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:12.765243 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1364/2690] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:12.775465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:12.777143 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:12.835775 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209472-a98f-43d5-8a5f-4493143d3deb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:12.839504 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318be99-c143-4801-beaa-3e50edd6b4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:12.840091 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318be99-c143-4801-beaa-3e50edd6b4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:12.840399 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318be99-c143-4801-beaa-3e50edd6b4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:12.840656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318be99-c143-4801-beaa-3e50edd6b4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:12.850120 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318be99-c143-4801-beaa-3e50edd6b4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:12.851652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318be99-c143-4801-beaa-3e50edd6b4d4 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:12.861920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1327/2691] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 17:17:13.137817 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e338d-b44f-4c1e-a7fb-229f87ce2906 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:13.139969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-747e338d-b44f-4c1e-a7fb-229f87ce2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:13.165123 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e338d-b44f-4c1e-a7fb-229f87ce2906 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:13.171092 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:13.171744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:13.172020 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:13.172289 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] PATH_INFO: `/v3/projects/58bba03cd43642c4b613b5e5afb2b017` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:13.173479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58bba03cd43642c4b613b5e5afb2b017)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:13.175421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:13.228606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58bba03cd43642c4b613b5e5afb2b017', 'request_id': 'req-3c709dfe-f8e5-44ae-a273-e41def9defc2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:13.234700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58bba03cd43642c4b613b5e5afb2b017', 'request_id': 'req-3c709dfe-f8e5-44ae-a273-e41def9defc2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:13.242744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58bba03cd43642c4b613b5e5afb2b017', 'request_id': 'req-3c709dfe-f8e5-44ae-a273-e41def9defc2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:13.244236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:13.260806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] The token cache is being invalidate because project 58bba03cd43642c4b613b5e5afb2b017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:13.261666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:13.262613 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:13.265115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1365/2692] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:13 2022] DELETE /identity/v3/projects/58bba03cd43642c4b613b5e5afb2b017 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:13.268761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318be99-c143-4801-beaa-3e50edd6b4d4 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:13.279274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318be99-c143-4801-beaa-3e50edd6b4d4 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:13.343895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:13.344658 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:13.344998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:13.345365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] PATH_INFO: `/v3/users/f101016677dc410aaa66947d14316a42` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:13.346596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f101016677dc410aaa66947d14316a42)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:13.348749 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:13.389377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:13.407300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f101016677dc410aaa66947d14316a42'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:13.414925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f101016677dc410aaa66947d14316a42'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:13.415751 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f101016677dc410aaa66947d14316a42'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:13.424694 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f101016677dc410aaa66947d14316a42'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:13.426166 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ce4b8346-59e2-4997-848a-adaf5f1314e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f101016677dc410aaa66947d14316a42'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:13.447585 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1328/2693] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:13 2022] DELETE /identity/v3/users/f101016677dc410aaa66947d14316a42 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:13.885021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:13.886850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:13.908178 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c709dfe-f8e5-44ae-a273-e41def9defc2 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:13.995487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:13.996154 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:13.996434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:13.996709 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] PATH_INFO: `/v3/projects/056af5770e9f4d679197a4fef26979a7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:13.997898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=056af5770e9f4d679197a4fef26979a7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.000217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.067611 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056af5770e9f4d679197a4fef26979a7', 'request_id': 'req-449c8f65-b82f-4c41-b148-5cb73171b90e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:14.073230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056af5770e9f4d679197a4fef26979a7', 'request_id': 'req-449c8f65-b82f-4c41-b148-5cb73171b90e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:14.081724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056af5770e9f4d679197a4fef26979a7', 'request_id': 'req-449c8f65-b82f-4c41-b148-5cb73171b90e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:14.093706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] The token cache is being invalidate because project 056af5770e9f4d679197a4fef26979a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:14.094001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:14.094632 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-449c8f65-b82f-4c41-b148-5cb73171b90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:14.096338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1366/2694] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:13 2022] DELETE /identity/v3/projects/056af5770e9f4d679197a4fef26979a7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:14.101329 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c7cfd-974f-4ddf-b8fa-f6ba83c9ee74 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.101838 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c7cfd-974f-4ddf-b8fa-f6ba83c9ee74 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.101944 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c7cfd-974f-4ddf-b8fa-f6ba83c9ee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.123079 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ec7c7cfd-974f-4ddf-b8fa-f6ba83c9ee74 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:14.124691 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ec7c7cfd-974f-4ddf-b8fa-f6ba83c9ee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:14.201970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1329/2695] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:14.211521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec7e5-c049-47f1-a8ab-b61c254bbb49 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.211815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec7e5-c049-47f1-a8ab-b61c254bbb49 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.212095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec7e5-c049-47f1-a8ab-b61c254bbb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.232459 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-69dec7e5-c049-47f1-a8ab-b61c254bbb49 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:14.233866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-69dec7e5-c049-47f1-a8ab-b61c254bbb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:14.242523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1367/2696] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:14.246904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c7cfd-974f-4ddf-b8fa-f6ba83c9ee74 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.257331 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c7cfd-974f-4ddf-b8fa-f6ba83c9ee74 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:14.262080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19961807-8faf-48d8-a871-6c0dfff30030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:14.262693 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961807-8faf-48d8-a871-6c0dfff30030 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.262962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961807-8faf-48d8-a871-6c0dfff30030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.263227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19961807-8faf-48d8-a871-6c0dfff30030 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.263899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19961807-8faf-48d8-a871-6c0dfff30030 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:17:14.264190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19961807-8faf-48d8-a871-6c0dfff30030 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.266712 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19961807-8faf-48d8-a871-6c0dfff30030 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.284175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1330/2697] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:17:14.288845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec7e5-c049-47f1-a8ab-b61c254bbb49 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.298531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec7e5-c049-47f1-a8ab-b61c254bbb49 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:14.303737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12861e48-e189-48ba-a0a6-d3ef603cc046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:14.304364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12861e48-e189-48ba-a0a6-d3ef603cc046 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.304653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12861e48-e189-48ba-a0a6-d3ef603cc046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.304923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12861e48-e189-48ba-a0a6-d3ef603cc046 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.305610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12861e48-e189-48ba-a0a6-d3ef603cc046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.307579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12861e48-e189-48ba-a0a6-d3ef603cc046 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.339161 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1368/2698] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:14 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:17:14.343344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19961807-8faf-48d8-a871-6c0dfff30030 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.353930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19961807-8faf-48d8-a871-6c0dfff30030 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:14.412866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c46a29-7998-4ddc-8808-0d1ed948c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:14.413424 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c46a29-7998-4ddc-8808-0d1ed948c3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.413705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c46a29-7998-4ddc-8808-0d1ed948c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.413975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c46a29-7998-4ddc-8808-0d1ed948c3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.414622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c46a29-7998-4ddc-8808-0d1ed948c3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.416541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c46a29-7998-4ddc-8808-0d1ed948c3e9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.438497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1331/2699] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:14 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:14.442673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12861e48-e189-48ba-a0a6-d3ef603cc046 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.453275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12861e48-e189-48ba-a0a6-d3ef603cc046 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:14.458964 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae65cc-0d33-46d3-a274-9b5bbfd3ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:14.459659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae65cc-0d33-46d3-a274-9b5bbfd3ff84 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.459942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae65cc-0d33-46d3-a274-9b5bbfd3ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.460217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae65cc-0d33-46d3-a274-9b5bbfd3ff84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.461695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae65cc-0d33-46d3-a274-9b5bbfd3ff84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.463719 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae65cc-0d33-46d3-a274-9b5bbfd3ff84 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.474852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1369/2700] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:14.478943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c46a29-7998-4ddc-8808-0d1ed948c3e9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.489435 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c46a29-7998-4ddc-8808-0d1ed948c3e9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:14.494203 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aca9ce-0e34-4126-a99f-f5d02554ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:14.494833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aca9ce-0e34-4126-a99f-f5d02554ce3a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.495112 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aca9ce-0e34-4126-a99f-f5d02554ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.495383 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aca9ce-0e34-4126-a99f-f5d02554ce3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.496040 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aca9ce-0e34-4126-a99f-f5d02554ce3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.497702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aca9ce-0e34-4126-a99f-f5d02554ce3a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.509902 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1332/2701] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:14.514348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae65cc-0d33-46d3-a274-9b5bbfd3ff84 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.524662 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae65cc-0d33-46d3-a274-9b5bbfd3ff84 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:14.529579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea1feb-9232-4193-9589-d7b2f7019c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:14.530250 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea1feb-9232-4193-9589-d7b2f7019c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.530513 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea1feb-9232-4193-9589-d7b2f7019c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.530788 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea1feb-9232-4193-9589-d7b2f7019c0f admin admin] PATH_INFO: `/v3/projects/3d6aa60f174643128b98c9924a9badeb/users/089e7e4b5a614853889244683943b361/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.546039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea1feb-9232-4193-9589-d7b2f7019c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6aa60f174643128b98c9924a9badeb, user_id=089e7e4b5a614853889244683943b361, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.548784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea1feb-9232-4193-9589-d7b2f7019c0f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.563952 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1370/2702] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:14 2022] PUT /identity/v3/projects/3d6aa60f174643128b98c9924a9badeb/users/089e7e4b5a614853889244683943b361/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:14.574587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8a551-f13f-4bd3-a7be-963ec9eafae0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.574873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8a551-f13f-4bd3-a7be-963ec9eafae0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.575145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8a551-f13f-4bd3-a7be-963ec9eafae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.601142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:14.604764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6ed8a551-f13f-4bd3-a7be-963ec9eafae0 None None] MFA Rules not processed for user `089e7e4b5a614853889244683943b361`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:14.607048 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6ed8a551-f13f-4bd3-a7be-963ec9eafae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:14.677162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1333/2703] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:14.681970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea1feb-9232-4193-9589-d7b2f7019c0f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.703923 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:14.748511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea1feb-9232-4193-9589-d7b2f7019c0f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:14.754124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97474895-03dc-46b4-8546-07e187b29fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:14.754729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97474895-03dc-46b4-8546-07e187b29fcf admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.755005 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97474895-03dc-46b4-8546-07e187b29fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.755281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97474895-03dc-46b4-8546-07e187b29fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.755941 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97474895-03dc-46b4-8546-07e187b29fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.757978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97474895-03dc-46b4-8546-07e187b29fcf admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.788762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1371/2704] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:14 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:14.793230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8a551-f13f-4bd3-a7be-963ec9eafae0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.805914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8a551-f13f-4bd3-a7be-963ec9eafae0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:14.864957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13c0fa-f28c-42fb-b8e9-4fa90a9fe951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:14.865603 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13c0fa-f28c-42fb-b8e9-4fa90a9fe951 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.865888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13c0fa-f28c-42fb-b8e9-4fa90a9fe951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.866158 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13c0fa-f28c-42fb-b8e9-4fa90a9fe951 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.866799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13c0fa-f28c-42fb-b8e9-4fa90a9fe951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.868714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13c0fa-f28c-42fb-b8e9-4fa90a9fe951 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.891880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1334/2705] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:14 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:17:14.896101 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97474895-03dc-46b4-8546-07e187b29fcf admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.907046 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97474895-03dc-46b4-8546-07e187b29fcf admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:14.912340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d63d-5d12-48b9-a6ab-1b6fd475f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:14.913018 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d63d-5d12-48b9-a6ab-1b6fd475f452 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.913329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d63d-5d12-48b9-a6ab-1b6fd475f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.913602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d63d-5d12-48b9-a6ab-1b6fd475f452 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.914268 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492d63d-5d12-48b9-a6ab-1b6fd475f452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.915885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492d63d-5d12-48b9-a6ab-1b6fd475f452 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.927057 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1372/2706] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:14.931132 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13c0fa-f28c-42fb-b8e9-4fa90a9fe951 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.941105 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13c0fa-f28c-42fb-b8e9-4fa90a9fe951 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:14.946109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b1bd0-8b61-4fe9-a1c9-efa10363dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:14.946764 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b1bd0-8b61-4fe9-a1c9-efa10363dc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:14.947037 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b1bd0-8b61-4fe9-a1c9-efa10363dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:14.947309 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b1bd0-8b61-4fe9-a1c9-efa10363dc1e admin admin] PATH_INFO: `/v3/projects/631f265b17db43c9929b84dcad856a6b/users/0517ddd44ff745b388fc576e846ccea2/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:14.962990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b1bd0-8b61-4fe9-a1c9-efa10363dc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=631f265b17db43c9929b84dcad856a6b, user_id=0517ddd44ff745b388fc576e846ccea2, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:14.965701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b1bd0-8b61-4fe9-a1c9-efa10363dc1e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:14.981738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1335/2707] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:14 2022] PUT /identity/v3/projects/631f265b17db43c9929b84dcad856a6b/users/0517ddd44ff745b388fc576e846ccea2/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:14.985827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d63d-5d12-48b9-a6ab-1b6fd475f452 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:14.996052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d63d-5d12-48b9-a6ab-1b6fd475f452 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:15.054726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c003ef-c99f-4942-8c62-1b1ca127523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:15.055514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c003ef-c99f-4942-8c62-1b1ca127523a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:15.055803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c003ef-c99f-4942-8c62-1b1ca127523a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:15.056166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c003ef-c99f-4942-8c62-1b1ca127523a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:15.056820 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c003ef-c99f-4942-8c62-1b1ca127523a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:15.058466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c003ef-c99f-4942-8c62-1b1ca127523a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:15.068320 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1373/2708] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:15.072497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b1bd0-8b61-4fe9-a1c9-efa10363dc1e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:15.083017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b1bd0-8b61-4fe9-a1c9-efa10363dc1e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:15.088029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebebc9-6a3e-4fa2-97f7-ec023e7beed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:15.088672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebebc9-6a3e-4fa2-97f7-ec023e7beed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:15.088920 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebebc9-6a3e-4fa2-97f7-ec023e7beed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:15.089233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebebc9-6a3e-4fa2-97f7-ec023e7beed8 admin admin] PATH_INFO: `/v3/projects/631f265b17db43c9929b84dcad856a6b/users/0517ddd44ff745b388fc576e846ccea2/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:15.091190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebebc9-6a3e-4fa2-97f7-ec023e7beed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631f265b17db43c9929b84dcad856a6b, user_id=0517ddd44ff745b388fc576e846ccea2, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:15.093880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebebc9-6a3e-4fa2-97f7-ec023e7beed8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:15.105197 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1336/2709] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:15 2022] PUT /identity/v3/projects/631f265b17db43c9929b84dcad856a6b/users/0517ddd44ff745b388fc576e846ccea2/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:15.116508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9ca52-34a6-4788-b022-a4c39307ba43 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:15.116802 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9ca52-34a6-4788-b022-a4c39307ba43 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:15.117125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9ca52-34a6-4788-b022-a4c39307ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:15.148929 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-4ee9ca52-34a6-4788-b022-a4c39307ba43 None None] MFA Rules not processed for user `0517ddd44ff745b388fc576e846ccea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:15.150215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4ee9ca52-34a6-4788-b022-a4c39307ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:15.220777 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1374/2710] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:15.231990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebebc9-6a3e-4fa2-97f7-ec023e7beed8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:15.233915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-39ebebc9-6a3e-4fa2-97f7-ec023e7beed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:15.294359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebebc9-6a3e-4fa2-97f7-ec023e7beed8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:15.298392 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9a2da-5514-4b35-aa5e-ff7a55b52641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:15.298992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a2da-5514-4b35-aa5e-ff7a55b52641 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:15.299273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a2da-5514-4b35-aa5e-ff7a55b52641 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:15.299542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a2da-5514-4b35-aa5e-ff7a55b52641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:15.309868 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9a2da-5514-4b35-aa5e-ff7a55b52641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:15.311353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9a2da-5514-4b35-aa5e-ff7a55b52641 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:15.315468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:15.322778 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1337/2711] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:16.799706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9ca52-34a6-4788-b022-a4c39307ba43 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:16.817480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:16.864645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9ca52-34a6-4788-b022-a4c39307ba43 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:16.870676 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:16.871315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:16.871602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:16.871880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] PATH_INFO: `/v3/users/089e7e4b5a614853889244683943b361` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:16.873109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089e7e4b5a614853889244683943b361)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:16.875448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:16.923881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089e7e4b5a614853889244683943b361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:16.924565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089e7e4b5a614853889244683943b361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:16.936831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089e7e4b5a614853889244683943b361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:16.945285 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089e7e4b5a614853889244683943b361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:16.945939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089e7e4b5a614853889244683943b361'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:16.958530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1375/2712] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:16 2022] DELETE /identity/v3/users/089e7e4b5a614853889244683943b361 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:16.963266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e6e2-de70-43a6-9572-3ed0fb0165c7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:16.963730 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e6e2-de70-43a6-9572-3ed0fb0165c7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:16.963925 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3e6e2-de70-43a6-9572-3ed0fb0165c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:16.985536 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d4d3e6e2-de70-43a6-9572-3ed0fb0165c7 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:16.987572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d4d3e6e2-de70-43a6-9572-3ed0fb0165c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:17.054060 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1338/2713] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:17.063924 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:17.065557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:17.126076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc278b92-db9e-44a7-a3c3-fa15db263145 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:17.130602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f335e-7293-4da3-9964-0bad532df12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:17.131237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f335e-7293-4da3-9964-0bad532df12c service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:17.131518 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f335e-7293-4da3-9964-0bad532df12c service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:17.131791 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f335e-7293-4da3-9964-0bad532df12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:17.142706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f335e-7293-4da3-9964-0bad532df12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:17.144962 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f335e-7293-4da3-9964-0bad532df12c service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:17.155679 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1376/2714] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:17.429274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e6e2-de70-43a6-9572-3ed0fb0165c7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:17.430823 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d4d3e6e2-de70-43a6-9572-3ed0fb0165c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:17.443742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3e6e2-de70-43a6-9572-3ed0fb0165c7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:17.448943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:17.449738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:17.449892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:17.450134 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] PATH_INFO: `/v3/projects/3d6aa60f174643128b98c9924a9badeb` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:17.451287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6aa60f174643128b98c9924a9badeb)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:17.453235 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:17.500619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6aa60f174643128b98c9924a9badeb', 'request_id': 'req-2579e272-09b1-49ca-b503-7df09fde8a18'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:17.506395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6aa60f174643128b98c9924a9badeb', 'request_id': 'req-2579e272-09b1-49ca-b503-7df09fde8a18'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:17.515171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6aa60f174643128b98c9924a9badeb', 'request_id': 'req-2579e272-09b1-49ca-b503-7df09fde8a18'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:17.526484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] The token cache is being invalidate because project 3d6aa60f174643128b98c9924a9badeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:17.526768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:17.527424 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:17.528971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1339/2715] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:17 2022] DELETE /identity/v3/projects/3d6aa60f174643128b98c9924a9badeb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:17.533066 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f335e-7293-4da3-9964-0bad532df12c service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:17.543301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f335e-7293-4da3-9964-0bad532df12c service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:17.577389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:17.603890 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:17.604527 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:17.604813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:17.605150 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] PATH_INFO: `/v3/users/0517ddd44ff745b388fc576e846ccea2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:17.606358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0517ddd44ff745b388fc576e846ccea2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:17.608335 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:17.660253 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0517ddd44ff745b388fc576e846ccea2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:17.660910 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0517ddd44ff745b388fc576e846ccea2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:17.672646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0517ddd44ff745b388fc576e846ccea2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:17.682309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0517ddd44ff745b388fc576e846ccea2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:17.683098 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-8d44a6e5-dc3b-4423-a64d-1762177931b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0517ddd44ff745b388fc576e846ccea2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:17.696112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1377/2716] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:17 2022] DELETE /identity/v3/users/0517ddd44ff745b388fc576e846ccea2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:17.973802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:17.975471 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:17.995438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579e272-09b1-49ca-b503-7df09fde8a18 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.054124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.054761 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.055034 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.055302 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] PATH_INFO: `/v3/projects/631f265b17db43c9929b84dcad856a6b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.056461 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=631f265b17db43c9929b84dcad856a6b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.058407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.082815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:18.108312 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631f265b17db43c9929b84dcad856a6b', 'request_id': 'req-95e79968-8863-4002-a6de-39c18f653e1b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:18.114006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631f265b17db43c9929b84dcad856a6b', 'request_id': 'req-95e79968-8863-4002-a6de-39c18f653e1b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:18.122070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631f265b17db43c9929b84dcad856a6b', 'request_id': 'req-95e79968-8863-4002-a6de-39c18f653e1b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:18.133655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] The token cache is being invalidate because project 631f265b17db43c9929b84dcad856a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:18.133942 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:18.134590 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95e79968-8863-4002-a6de-39c18f653e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:18.136184 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1340/2717] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:17 2022] DELETE /identity/v3/projects/631f265b17db43c9929b84dcad856a6b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:18.141498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d400-1f37-4086-8582-a443c3b84c85 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.141928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d400-1f37-4086-8582-a443c3b84c85 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.142022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884d400-1f37-4086-8582-a443c3b84c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.163893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0884d400-1f37-4086-8582-a443c3b84c85 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:18.165150 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0884d400-1f37-4086-8582-a443c3b84c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:18.229309 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1378/2718] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:18.237670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f9c2a-4c74-4f6f-9aca-6652b9f8033c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.237954 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f9c2a-4c74-4f6f-9aca-6652b9f8033c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.238227 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f9c2a-4c74-4f6f-9aca-6652b9f8033c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.259175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5b4f9c2a-4c74-4f6f-9aca-6652b9f8033c None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:18.260370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5b4f9c2a-4c74-4f6f-9aca-6652b9f8033c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:18.269065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1341/2719] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:18.273563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884d400-1f37-4086-8582-a443c3b84c85 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:18.283805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884d400-1f37-4086-8582-a443c3b84c85 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.289297 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba851c-94a6-4dac-9769-9af8ca5698a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.289893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba851c-94a6-4dac-9769-9af8ca5698a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.290172 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba851c-94a6-4dac-9769-9af8ca5698a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.290448 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba851c-94a6-4dac-9769-9af8ca5698a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.291095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba851c-94a6-4dac-9769-9af8ca5698a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:17:18.291395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba851c-94a6-4dac-9769-9af8ca5698a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.293001 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba851c-94a6-4dac-9769-9af8ca5698a6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.304701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1379/2720] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:17:18.309015 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f9c2a-4c74-4f6f-9aca-6652b9f8033c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:18.318398 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f9c2a-4c74-4f6f-9aca-6652b9f8033c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.323290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79b35d-cd48-445c-86fd-179db9b254ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.323880 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79b35d-cd48-445c-86fd-179db9b254ea admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.324157 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79b35d-cd48-445c-86fd-179db9b254ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.324423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79b35d-cd48-445c-86fd-179db9b254ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.325066 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79b35d-cd48-445c-86fd-179db9b254ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.327008 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79b35d-cd48-445c-86fd-179db9b254ea admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.356212 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1342/2721] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:18 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:18.360515 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba851c-94a6-4dac-9769-9af8ca5698a6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:18.370786 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba851c-94a6-4dac-9769-9af8ca5698a6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.417915 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:18.437002 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8463f-c1a6-410d-8094-d6020ca1bcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.437721 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8463f-c1a6-410d-8094-d6020ca1bcda admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.438003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8463f-c1a6-410d-8094-d6020ca1bcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.438279 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8463f-c1a6-410d-8094-d6020ca1bcda admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.438914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8463f-c1a6-410d-8094-d6020ca1bcda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.440850 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8463f-c1a6-410d-8094-d6020ca1bcda admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.464085 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1380/2722] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:18 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:18.468568 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79b35d-cd48-445c-86fd-179db9b254ea admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:18.479627 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79b35d-cd48-445c-86fd-179db9b254ea admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.486116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630bf34-f6da-4452-83ad-36a5c82e142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.486719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630bf34-f6da-4452-83ad-36a5c82e142c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.486998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630bf34-f6da-4452-83ad-36a5c82e142c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.487265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630bf34-f6da-4452-83ad-36a5c82e142c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.487913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630bf34-f6da-4452-83ad-36a5c82e142c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.489570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630bf34-f6da-4452-83ad-36a5c82e142c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.501190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1343/2723] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:18.506086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8463f-c1a6-410d-8094-d6020ca1bcda admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:18.521315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8463f-c1a6-410d-8094-d6020ca1bcda admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.527162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5878c5-9804-49f4-9d29-784bc5d23f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.527824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5878c5-9804-49f4-9d29-784bc5d23f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.528109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5878c5-9804-49f4-9d29-784bc5d23f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.528388 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5878c5-9804-49f4-9d29-784bc5d23f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.529071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5878c5-9804-49f4-9d29-784bc5d23f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.530697 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5878c5-9804-49f4-9d29-784bc5d23f80 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.541180 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1381/2724] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:18.545473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630bf34-f6da-4452-83ad-36a5c82e142c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:18.556049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630bf34-f6da-4452-83ad-36a5c82e142c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.561054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7c3e2-5532-476e-8c4b-8c225c7c5cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.561710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c3e2-5532-476e-8c4b-8c225c7c5cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.561989 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c3e2-5532-476e-8c4b-8c225c7c5cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.562265 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7c3e2-5532-476e-8c4b-8c225c7c5cf7 admin admin] PATH_INFO: `/v3/projects/02d2e93f356f42619a3c57dd7427da63/users/bab813efe2fa4444bf019c17bb255497/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.577476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7c3e2-5532-476e-8c4b-8c225c7c5cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d2e93f356f42619a3c57dd7427da63, user_id=bab813efe2fa4444bf019c17bb255497, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.580114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7c3e2-5532-476e-8c4b-8c225c7c5cf7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.595382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1344/2725] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:18 2022] PUT /identity/v3/projects/02d2e93f356f42619a3c57dd7427da63/users/bab813efe2fa4444bf019c17bb255497/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:18.606052 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dc10c-498a-4891-8cd7-f3a85e7bf70d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.606371 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dc10c-498a-4891-8cd7-f3a85e7bf70d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.606651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dc10c-498a-4891-8cd7-f3a85e7bf70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.635187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-d50dc10c-498a-4891-8cd7-f3a85e7bf70d None None] MFA Rules not processed for user `bab813efe2fa4444bf019c17bb255497`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:18.636312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d50dc10c-498a-4891-8cd7-f3a85e7bf70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:18.704811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1382/2726] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:17:18.709888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7c3e2-5532-476e-8c4b-8c225c7c5cf7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:18.776901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7c3e2-5532-476e-8c4b-8c225c7c5cf7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.782975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5df92-fe93-4d0e-ade3-49a05bb926a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.783584 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5df92-fe93-4d0e-ade3-49a05bb926a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.783862 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5df92-fe93-4d0e-ade3-49a05bb926a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.784128 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5df92-fe93-4d0e-ade3-49a05bb926a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.784754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5df92-fe93-4d0e-ade3-49a05bb926a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.786715 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5df92-fe93-4d0e-ade3-49a05bb926a7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.818394 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1345/2727] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:18 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:18.822858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dc10c-498a-4891-8cd7-f3a85e7bf70d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:18.833620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dc10c-498a-4891-8cd7-f3a85e7bf70d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.892746 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3842667-116f-4a59-adb4-18a1b5108021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.893307 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3842667-116f-4a59-adb4-18a1b5108021 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.893591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3842667-116f-4a59-adb4-18a1b5108021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.893868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3842667-116f-4a59-adb4-18a1b5108021 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.894501 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3842667-116f-4a59-adb4-18a1b5108021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.896443 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3842667-116f-4a59-adb4-18a1b5108021 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.919569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1383/2728] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:18 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:18.923955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5df92-fe93-4d0e-ade3-49a05bb926a7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:18.934716 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5df92-fe93-4d0e-ade3-49a05bb926a7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.939548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e22ec-3d87-45b4-935a-82ba868633c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.940178 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e22ec-3d87-45b4-935a-82ba868633c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.940462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e22ec-3d87-45b4-935a-82ba868633c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.940735 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e22ec-3d87-45b4-935a-82ba868633c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.941397 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e22ec-3d87-45b4-935a-82ba868633c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.943142 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e22ec-3d87-45b4-935a-82ba868633c9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.954224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1346/2729] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:18.958328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3842667-116f-4a59-adb4-18a1b5108021 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:18.968899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3842667-116f-4a59-adb4-18a1b5108021 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:18.974807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84aa59-e5bb-4151-871a-2991e28353e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:18.975396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84aa59-e5bb-4151-871a-2991e28353e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:18.975794 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84aa59-e5bb-4151-871a-2991e28353e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:18.976119 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84aa59-e5bb-4151-871a-2991e28353e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:18.976881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84aa59-e5bb-4151-871a-2991e28353e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:18.979003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84aa59-e5bb-4151-871a-2991e28353e1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:18.989827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1384/2730] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:17:18.994228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e22ec-3d87-45b4-935a-82ba868633c9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:19.005208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e22ec-3d87-45b4-935a-82ba868633c9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:19.011357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927494c6-a5e0-4702-9724-69185a156e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:19.012007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927494c6-a5e0-4702-9724-69185a156e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:19.012286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927494c6-a5e0-4702-9724-69185a156e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:19.012557 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927494c6-a5e0-4702-9724-69185a156e4a admin admin] PATH_INFO: `/v3/projects/9d60d3cef50e4c239fecf8c68236bf9e/users/2d3eae1a663740db90d899080d5b44e0/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:19.028019 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927494c6-a5e0-4702-9724-69185a156e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d60d3cef50e4c239fecf8c68236bf9e, user_id=2d3eae1a663740db90d899080d5b44e0, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:19.030702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927494c6-a5e0-4702-9724-69185a156e4a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:19.041856 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:19.048441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1347/2731] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:18 2022] PUT /identity/v3/projects/9d60d3cef50e4c239fecf8c68236bf9e/users/2d3eae1a663740db90d899080d5b44e0/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:19.060852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134961b-04d7-4802-86a5-fb449c2c4cac None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:19.061302 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134961b-04d7-4802-86a5-fb449c2c4cac None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:19.061731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134961b-04d7-4802-86a5-fb449c2c4cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:19.092792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f134961b-04d7-4802-86a5-fb449c2c4cac None None] MFA Rules not processed for user `2d3eae1a663740db90d899080d5b44e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:19.094112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f134961b-04d7-4802-86a5-fb449c2c4cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:19.112799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:19.163168 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1385/2732] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:19.167934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927494c6-a5e0-4702-9724-69185a156e4a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:19.227894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927494c6-a5e0-4702-9724-69185a156e4a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:19.233247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568a46d-7442-418b-952b-b78f10a715b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:19.233840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568a46d-7442-418b-952b-b78f10a715b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:19.234114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568a46d-7442-418b-952b-b78f10a715b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:19.234380 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568a46d-7442-418b-952b-b78f10a715b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:19.235009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568a46d-7442-418b-952b-b78f10a715b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:19.236895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568a46d-7442-418b-952b-b78f10a715b8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:19.265813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1348/2733] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:19 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:17:19.271869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134961b-04d7-4802-86a5-fb449c2c4cac None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:19.282678 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134961b-04d7-4802-86a5-fb449c2c4cac None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:19.343229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103a13d-f7c0-4f4d-a5a4-07bcdc706731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:19.343854 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103a13d-f7c0-4f4d-a5a4-07bcdc706731 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:19.344137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103a13d-f7c0-4f4d-a5a4-07bcdc706731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:19.344410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103a13d-f7c0-4f4d-a5a4-07bcdc706731 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:19.345064 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103a13d-f7c0-4f4d-a5a4-07bcdc706731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:19.347013 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103a13d-f7c0-4f4d-a5a4-07bcdc706731 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:19.369601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1386/2734] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:19 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:19.373698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568a46d-7442-418b-952b-b78f10a715b8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:19.384953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568a46d-7442-418b-952b-b78f10a715b8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:19.390185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78196d7e-155f-4919-aa95-abc2cd33fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:19.390780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78196d7e-155f-4919-aa95-abc2cd33fc80 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:19.391056 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78196d7e-155f-4919-aa95-abc2cd33fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:19.391352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78196d7e-155f-4919-aa95-abc2cd33fc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:19.391992 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78196d7e-155f-4919-aa95-abc2cd33fc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:19.393636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78196d7e-155f-4919-aa95-abc2cd33fc80 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:19.404369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1349/2735] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:19.408428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103a13d-f7c0-4f4d-a5a4-07bcdc706731 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:19.419399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103a13d-f7c0-4f4d-a5a4-07bcdc706731 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:19.424391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e141b8-bd81-4f3a-8bb9-0760bdfd7106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:19.425061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e141b8-bd81-4f3a-8bb9-0760bdfd7106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:19.425327 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e141b8-bd81-4f3a-8bb9-0760bdfd7106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:19.425607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e141b8-bd81-4f3a-8bb9-0760bdfd7106 admin admin] PATH_INFO: `/v3/projects/23e34416a50a44118b89d98a98b67b57/users/48ba57a7e940438db9b4cef10350d330/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:19.440623 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e141b8-bd81-4f3a-8bb9-0760bdfd7106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e34416a50a44118b89d98a98b67b57, user_id=48ba57a7e940438db9b4cef10350d330, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:19.443329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e141b8-bd81-4f3a-8bb9-0760bdfd7106 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:19.459152 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1387/2736] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:19 2022] PUT /identity/v3/projects/23e34416a50a44118b89d98a98b67b57/users/48ba57a7e940438db9b4cef10350d330/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:19.463440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78196d7e-155f-4919-aa95-abc2cd33fc80 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:19.473980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78196d7e-155f-4919-aa95-abc2cd33fc80 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:19.533348 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28166d-3f22-40b8-8846-d3563d56d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:19.533966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28166d-3f22-40b8-8846-d3563d56d931 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:19.534233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28166d-3f22-40b8-8846-d3563d56d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:19.534527 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28166d-3f22-40b8-8846-d3563d56d931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:19.535172 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28166d-3f22-40b8-8846-d3563d56d931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:19.536888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28166d-3f22-40b8-8846-d3563d56d931 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:19.547050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1350/2737] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:17:19.551440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e141b8-bd81-4f3a-8bb9-0760bdfd7106 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:19.562498 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e141b8-bd81-4f3a-8bb9-0760bdfd7106 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:19.567419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc0873-7081-4667-aeda-0359f8520ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:19.568287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0873-7081-4667-aeda-0359f8520ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:19.568649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0873-7081-4667-aeda-0359f8520ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:19.568928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc0873-7081-4667-aeda-0359f8520ed4 admin admin] PATH_INFO: `/v3/projects/23e34416a50a44118b89d98a98b67b57/users/48ba57a7e940438db9b4cef10350d330/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:19.571125 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc0873-7081-4667-aeda-0359f8520ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e34416a50a44118b89d98a98b67b57, user_id=48ba57a7e940438db9b4cef10350d330, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:19.573883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc0873-7081-4667-aeda-0359f8520ed4 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:19.584784 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1388/2738] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:19 2022] PUT /identity/v3/projects/23e34416a50a44118b89d98a98b67b57/users/48ba57a7e940438db9b4cef10350d330/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:17:19.595238 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54a61-2e5a-4018-97de-942cb4ca07d0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:19.595534 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54a61-2e5a-4018-97de-942cb4ca07d0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:19.595829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54a61-2e5a-4018-97de-942cb4ca07d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:19.624559 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-16b54a61-2e5a-4018-97de-942cb4ca07d0 None None] MFA Rules not processed for user `48ba57a7e940438db9b4cef10350d330`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:19.625844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-16b54a61-2e5a-4018-97de-942cb4ca07d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:19.686005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:19.697785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1351/2739] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:19.708770 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc0873-7081-4667-aeda-0359f8520ed4 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:19.710625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c1bc0873-7081-4667-aeda-0359f8520ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:19.770889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc0873-7081-4667-aeda-0359f8520ed4 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:19.774684 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a4dce-9c07-4034-b6fe-99449ac98aaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:19.775301 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a4dce-9c07-4034-b6fe-99449ac98aaa service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:19.775611 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a4dce-9c07-4034-b6fe-99449ac98aaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:19.775883 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a4dce-9c07-4034-b6fe-99449ac98aaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:19.785197 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a4dce-9c07-4034-b6fe-99449ac98aaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:19.786659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a4dce-9c07-4034-b6fe-99449ac98aaa service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:19.796783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1389/2740] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:20.335433 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b54a61-2e5a-4018-97de-942cb4ca07d0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:20.337179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-16b54a61-2e5a-4018-97de-942cb4ca07d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:20.350473 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b54a61-2e5a-4018-97de-942cb4ca07d0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:20.354692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc1a2-fd42-4916-85bd-02a624101fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:20.355291 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc1a2-fd42-4916-85bd-02a624101fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:20.355567 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc1a2-fd42-4916-85bd-02a624101fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:20.355835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc1a2-fd42-4916-85bd-02a624101fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:20.413882 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecc1a2-fd42-4916-85bd-02a624101fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:20.415300 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecc1a2-fd42-4916-85bd-02a624101fc5 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:20.424418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1352/2741] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:24.497961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a4dce-9c07-4034-b6fe-99449ac98aaa service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:24.507521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a4dce-9c07-4034-b6fe-99449ac98aaa service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:24.511965 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6016e4-237d-40ff-bbea-52bcd110743e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:24.512569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6016e4-237d-40ff-bbea-52bcd110743e service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:24.512880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6016e4-237d-40ff-bbea-52bcd110743e service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:24.513172 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6016e4-237d-40ff-bbea-52bcd110743e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:24.525389 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:24.584509 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6016e4-237d-40ff-bbea-52bcd110743e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:24.586000 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6016e4-237d-40ff-bbea-52bcd110743e service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:24.595077 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1390/2742] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:26.749562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc1a2-fd42-4916-85bd-02a624101fc5 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:26.811737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc1a2-fd42-4916-85bd-02a624101fc5 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:26.817130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:26.817755 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:26.818032 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:26.818307 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] PATH_INFO: `/v3/users/bab813efe2fa4444bf019c17bb255497` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:26.819480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab813efe2fa4444bf019c17bb255497)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:26.821439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:26.870041 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab813efe2fa4444bf019c17bb255497'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:26.877633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab813efe2fa4444bf019c17bb255497'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:26.878359 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab813efe2fa4444bf019c17bb255497'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:26.887181 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab813efe2fa4444bf019c17bb255497'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:26.887785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab813efe2fa4444bf019c17bb255497'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:26.905980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1353/2743] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:26 2022] DELETE /identity/v3/users/bab813efe2fa4444bf019c17bb255497 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:26.910635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486af393-f1d5-4a11-8118-98f8f12d8668 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:26.911103 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486af393-f1d5-4a11-8118-98f8f12d8668 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:26.911232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486af393-f1d5-4a11-8118-98f8f12d8668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:26.931156 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-486af393-f1d5-4a11-8118-98f8f12d8668 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:26.932364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-486af393-f1d5-4a11-8118-98f8f12d8668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:26.997088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1391/2744] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:27.007415 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:27.009160 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:27.023802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:27.069576 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c59a6-ff30-4cce-98bf-4df05e25e0ef admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:27.073695 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe0762-0c7e-413d-a655-66759f206878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:27.074305 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe0762-0c7e-413d-a655-66759f206878 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:27.074578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe0762-0c7e-413d-a655-66759f206878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:27.074847 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe0762-0c7e-413d-a655-66759f206878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:27.084102 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe0762-0c7e-413d-a655-66759f206878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:27.085587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe0762-0c7e-413d-a655-66759f206878 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:27.094977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1354/2745] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:27.374796 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486af393-f1d5-4a11-8118-98f8f12d8668 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:27.376454 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-486af393-f1d5-4a11-8118-98f8f12d8668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:27.389122 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486af393-f1d5-4a11-8118-98f8f12d8668 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:27.394665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:27.395315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:27.395602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:27.395869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] PATH_INFO: `/v3/projects/02d2e93f356f42619a3c57dd7427da63` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:27.397051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d2e93f356f42619a3c57dd7427da63)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:27.398996 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:27.450690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d2e93f356f42619a3c57dd7427da63', 'request_id': 'req-9b244351-af2b-4801-9fb6-fc1707f9ac7a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:27.456749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d2e93f356f42619a3c57dd7427da63', 'request_id': 'req-9b244351-af2b-4801-9fb6-fc1707f9ac7a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:27.466988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d2e93f356f42619a3c57dd7427da63', 'request_id': 'req-9b244351-af2b-4801-9fb6-fc1707f9ac7a'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:27.478591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] The token cache is being invalidate because project 02d2e93f356f42619a3c57dd7427da63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:27.478881 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:27.479577 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:27.481193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1392/2746] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:27 2022] DELETE /identity/v3/projects/02d2e93f356f42619a3c57dd7427da63 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:27.485391 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe0762-0c7e-413d-a655-66759f206878 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:27.495448 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe0762-0c7e-413d-a655-66759f206878 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:27.555794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:27.556361 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:27.556644 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:27.556917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] PATH_INFO: `/v3/users/2d3eae1a663740db90d899080d5b44e0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:27.558214 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3eae1a663740db90d899080d5b44e0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:27.560138 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:27.617928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3eae1a663740db90d899080d5b44e0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:27.625503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3eae1a663740db90d899080d5b44e0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:27.626247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3eae1a663740db90d899080d5b44e0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:27.634338 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3eae1a663740db90d899080d5b44e0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:27.635377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3eae1a663740db90d899080d5b44e0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:27.653799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1355/2747] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:27 2022] DELETE /identity/v3/users/2d3eae1a663740db90d899080d5b44e0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:27.955453 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:27.957070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:27.972696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b244351-af2b-4801-9fb6-fc1707f9ac7a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:28.009098 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:28.033645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:28.034272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:28.034551 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:28.034823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] PATH_INFO: `/v3/projects/9d60d3cef50e4c239fecf8c68236bf9e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:28.035967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d60d3cef50e4c239fecf8c68236bf9e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:28.037947 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:28.085430 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d60d3cef50e4c239fecf8c68236bf9e', 'request_id': 'req-cb75e0cb-dc99-47d1-93cd-07f884578dd9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.090874 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d60d3cef50e4c239fecf8c68236bf9e', 'request_id': 'req-cb75e0cb-dc99-47d1-93cd-07f884578dd9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.099365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d60d3cef50e4c239fecf8c68236bf9e', 'request_id': 'req-cb75e0cb-dc99-47d1-93cd-07f884578dd9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.111137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] The token cache is being invalidate because project 9d60d3cef50e4c239fecf8c68236bf9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:28.111428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.112073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.113609 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1393/2748] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:27 2022] DELETE /identity/v3/projects/9d60d3cef50e4c239fecf8c68236bf9e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:28.117850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:28.119402 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:28.133390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131979c0-2f48-4c37-8c7a-d76342b55380 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:28.163962 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:28.191704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:28.192342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:28.192619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:28.192889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] PATH_INFO: `/v3/users/48ba57a7e940438db9b4cef10350d330` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:28.194072 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ba57a7e940438db9b4cef10350d330)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:28.195998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:28.246179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ba57a7e940438db9b4cef10350d330'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.253855 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ba57a7e940438db9b4cef10350d330'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.254514 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ba57a7e940438db9b4cef10350d330'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.267435 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ba57a7e940438db9b4cef10350d330'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.268268 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6932a9c-f642-4295-9a4e-6cfaa16c16e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ba57a7e940438db9b4cef10350d330'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.289835 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1356/2749] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:28 2022] DELETE /identity/v3/users/48ba57a7e940438db9b4cef10350d330 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:28.574102 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:28.575864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:28.590574 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e0cb-dc99-47d1-93cd-07f884578dd9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:28.661159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:28.661726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:28.662004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:28.662273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] PATH_INFO: `/v3/projects/23e34416a50a44118b89d98a98b67b57` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:28.663428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e34416a50a44118b89d98a98b67b57)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:28.665375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:28.717465 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e34416a50a44118b89d98a98b67b57', 'request_id': 'req-08747a29-9ac0-4921-8e30-d4cb85741291'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.723728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e34416a50a44118b89d98a98b67b57', 'request_id': 'req-08747a29-9ac0-4921-8e30-d4cb85741291'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.732172 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e34416a50a44118b89d98a98b67b57', 'request_id': 'req-08747a29-9ac0-4921-8e30-d4cb85741291'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.739278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:28.745106 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] The token cache is being invalidate because project 23e34416a50a44118b89d98a98b67b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:28.745449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.746135 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-08747a29-9ac0-4921-8e30-d4cb85741291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:28.747810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1394/2750] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:28 2022] DELETE /identity/v3/projects/23e34416a50a44118b89d98a98b67b57 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:28.754829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4d64-4e59-4762-8fb5-9b311264fea3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:28.755100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4d64-4e59-4762-8fb5-9b311264fea3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:28.755372 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4d64-4e59-4762-8fb5-9b311264fea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:28.776369 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-570a4d64-4e59-4762-8fb5-9b311264fea3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:28.777650 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-570a4d64-4e59-4762-8fb5-9b311264fea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:28.845970 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1357/2751] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:28.858590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec0f63-093d-4e94-88c5-513240cb16e5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:28.858885 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec0f63-093d-4e94-88c5-513240cb16e5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:28.859158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec0f63-093d-4e94-88c5-513240cb16e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:28.879637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-6eec0f63-093d-4e94-88c5-513240cb16e5 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:28.880857 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6eec0f63-093d-4e94-88c5-513240cb16e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:28.890112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1395/2752] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:28.894423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4d64-4e59-4762-8fb5-9b311264fea3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:28.904681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4d64-4e59-4762-8fb5-9b311264fea3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:28.910628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2990-55e3-49b9-ba0c-df2e06762410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:28.911290 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2990-55e3-49b9-ba0c-df2e06762410 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:28.911472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2990-55e3-49b9-ba0c-df2e06762410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:28.911759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e2990-55e3-49b9-ba0c-df2e06762410 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:28.912404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e2990-55e3-49b9-ba0c-df2e06762410 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:17:28.912698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e2990-55e3-49b9-ba0c-df2e06762410 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:28.914343 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e2990-55e3-49b9-ba0c-df2e06762410 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:28.926556 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1358/2753] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:17:28.930914 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec0f63-093d-4e94-88c5-513240cb16e5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:28.940526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec0f63-093d-4e94-88c5-513240cb16e5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:28.946889 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c971dd-a922-4412-be43-72d1c54f7143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:28.947472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c971dd-a922-4412-be43-72d1c54f7143 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:28.947749 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c971dd-a922-4412-be43-72d1c54f7143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:28.948101 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c971dd-a922-4412-be43-72d1c54f7143 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:28.948733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c971dd-a922-4412-be43-72d1c54f7143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:28.950687 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c971dd-a922-4412-be43-72d1c54f7143 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:28.980045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1396/2754] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:28 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:28.984791 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2990-55e3-49b9-ba0c-df2e06762410 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:28.995759 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e2990-55e3-49b9-ba0c-df2e06762410 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:29.035633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:29.056918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3ac01-ac65-4cc0-8d0d-38e428a5af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:29.057589 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3ac01-ac65-4cc0-8d0d-38e428a5af9b admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.057859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3ac01-ac65-4cc0-8d0d-38e428a5af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.058122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3ac01-ac65-4cc0-8d0d-38e428a5af9b admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.058743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3ac01-ac65-4cc0-8d0d-38e428a5af9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:29.060655 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3ac01-ac65-4cc0-8d0d-38e428a5af9b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:29.088573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1359/2755] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:28 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:29.094832 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c971dd-a922-4412-be43-72d1c54f7143 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:29.109202 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c971dd-a922-4412-be43-72d1c54f7143 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:29.115270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7638a-93ec-4b56-8f63-17fd4175f5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:29.115876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7638a-93ec-4b56-8f63-17fd4175f5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.116159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7638a-93ec-4b56-8f63-17fd4175f5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.116431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7638a-93ec-4b56-8f63-17fd4175f5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.117144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7638a-93ec-4b56-8f63-17fd4175f5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:29.118768 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7638a-93ec-4b56-8f63-17fd4175f5a0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:29.129720 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1397/2756] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:29.133719 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3ac01-ac65-4cc0-8d0d-38e428a5af9b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:29.144078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3ac01-ac65-4cc0-8d0d-38e428a5af9b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:29.149255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ac65f-41b6-4a5f-bb09-957a39898b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:29.149971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ac65f-41b6-4a5f-bb09-957a39898b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.150322 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ac65f-41b6-4a5f-bb09-957a39898b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.150664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ac65f-41b6-4a5f-bb09-957a39898b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.151432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ac65f-41b6-4a5f-bb09-957a39898b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:29.153145 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ac65f-41b6-4a5f-bb09-957a39898b58 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:29.164058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1360/2757] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:29.168330 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7638a-93ec-4b56-8f63-17fd4175f5a0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:29.178970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7638a-93ec-4b56-8f63-17fd4175f5a0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:29.184724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb03401-3a6c-4dc6-b6f3-aff6bde31af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:29.185449 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb03401-3a6c-4dc6-b6f3-aff6bde31af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.185724 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb03401-3a6c-4dc6-b6f3-aff6bde31af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.185992 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb03401-3a6c-4dc6-b6f3-aff6bde31af9 admin admin] PATH_INFO: `/v3/projects/65524148a2b54d10b0da46fceda5aa1a/users/7f48405bd5734d5992446cf09bf5dea9/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.201350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb03401-3a6c-4dc6-b6f3-aff6bde31af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65524148a2b54d10b0da46fceda5aa1a, user_id=7f48405bd5734d5992446cf09bf5dea9, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:29.203999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb03401-3a6c-4dc6-b6f3-aff6bde31af9 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:29.218949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1398/2758] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:29 2022] PUT /identity/v3/projects/65524148a2b54d10b0da46fceda5aa1a/users/7f48405bd5734d5992446cf09bf5dea9/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:29.289327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96b790-5cb8-4360-b408-e9a9ebe7e239 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.289688 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96b790-5cb8-4360-b408-e9a9ebe7e239 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.290035 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96b790-5cb8-4360-b408-e9a9ebe7e239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.327388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1d96b790-5cb8-4360-b408-e9a9ebe7e239 None None] MFA Rules not processed for user `7f48405bd5734d5992446cf09bf5dea9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:29.328628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1d96b790-5cb8-4360-b408-e9a9ebe7e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:29.393826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1361/2759] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:29.398712 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb03401-3a6c-4dc6-b6f3-aff6bde31af9 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:29.463758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb03401-3a6c-4dc6-b6f3-aff6bde31af9 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:29.468529 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef65f-8637-4a50-a022-e6c2b24eed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:29.469157 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef65f-8637-4a50-a022-e6c2b24eed9e admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.469434 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef65f-8637-4a50-a022-e6c2b24eed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.469689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ef65f-8637-4a50-a022-e6c2b24eed9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.470331 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ef65f-8637-4a50-a022-e6c2b24eed9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:29.472239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ef65f-8637-4a50-a022-e6c2b24eed9e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:29.501440 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1399/2760] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:29 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:29.505679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96b790-5cb8-4360-b408-e9a9ebe7e239 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:29.516998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96b790-5cb8-4360-b408-e9a9ebe7e239 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:29.572737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d8824-5764-41e2-b2da-9ce3900d9971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:29.573441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d8824-5764-41e2-b2da-9ce3900d9971 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.573704 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d8824-5764-41e2-b2da-9ce3900d9971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.573988 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d8824-5764-41e2-b2da-9ce3900d9971 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.574602 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d8824-5764-41e2-b2da-9ce3900d9971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:29.576505 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d8824-5764-41e2-b2da-9ce3900d9971 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:29.599304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1362/2761] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:29 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:29.603437 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef65f-8637-4a50-a022-e6c2b24eed9e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:29.614785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ef65f-8637-4a50-a022-e6c2b24eed9e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:29.620405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3c390-40f9-494e-b468-49ed4ba2675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:29.621014 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3c390-40f9-494e-b468-49ed4ba2675c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.621337 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3c390-40f9-494e-b468-49ed4ba2675c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.621617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3c390-40f9-494e-b468-49ed4ba2675c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.622272 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3c390-40f9-494e-b468-49ed4ba2675c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:29.624240 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3c390-40f9-494e-b468-49ed4ba2675c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:29.635211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1400/2762] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:29.639441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d8824-5764-41e2-b2da-9ce3900d9971 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:29.649885 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d8824-5764-41e2-b2da-9ce3900d9971 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:29.655055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f342ef-c537-4ba4-b2b1-220e4a10f8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:29.655649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f342ef-c537-4ba4-b2b1-220e4a10f8ea admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.655916 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f342ef-c537-4ba4-b2b1-220e4a10f8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.656228 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f342ef-c537-4ba4-b2b1-220e4a10f8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.656883 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f342ef-c537-4ba4-b2b1-220e4a10f8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:29.658552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f342ef-c537-4ba4-b2b1-220e4a10f8ea admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:29.668971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1363/2763] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:29.673358 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3c390-40f9-494e-b468-49ed4ba2675c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:29.684292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3c390-40f9-494e-b468-49ed4ba2675c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:29.689967 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3863722-33be-4ace-bbb6-ca5587dffa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:29.690651 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3863722-33be-4ace-bbb6-ca5587dffa55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.690931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3863722-33be-4ace-bbb6-ca5587dffa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.691207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3863722-33be-4ace-bbb6-ca5587dffa55 admin admin] PATH_INFO: `/v3/projects/a1e3b887e5484ea1be13221a59c0ae8e/users/8dfb2f9f59a645bbb28b3bae42e470f7/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.706519 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3863722-33be-4ace-bbb6-ca5587dffa55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e3b887e5484ea1be13221a59c0ae8e, user_id=8dfb2f9f59a645bbb28b3bae42e470f7, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:29.709220 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3863722-33be-4ace-bbb6-ca5587dffa55 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:29.727946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1401/2764] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:29 2022] PUT /identity/v3/projects/a1e3b887e5484ea1be13221a59c0ae8e/users/8dfb2f9f59a645bbb28b3bae42e470f7/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:29.739454 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7d4c-f118-4006-9e5d-266ee63a18e5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.739734 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7d4c-f118-4006-9e5d-266ee63a18e5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.740002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7d4c-f118-4006-9e5d-266ee63a18e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.773479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-38ff7d4c-f118-4006-9e5d-266ee63a18e5 None None] MFA Rules not processed for user `8dfb2f9f59a645bbb28b3bae42e470f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:29.774728 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-38ff7d4c-f118-4006-9e5d-266ee63a18e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:29.788395 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:29.844436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1364/2765] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:29.851728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3863722-33be-4ace-bbb6-ca5587dffa55 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:29.900171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:29.917665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3863722-33be-4ace-bbb6-ca5587dffa55 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:29.923048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722d888-c49f-4f08-862e-829e7a94f9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:29.923653 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722d888-c49f-4f08-862e-829e7a94f9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:29.923939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722d888-c49f-4f08-862e-829e7a94f9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:29.924215 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722d888-c49f-4f08-862e-829e7a94f9b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:29.924847 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722d888-c49f-4f08-862e-829e7a94f9b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:29.926843 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722d888-c49f-4f08-862e-829e7a94f9b8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:29.955230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1402/2766] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:29 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:29.959533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7d4c-f118-4006-9e5d-266ee63a18e5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:29.971513 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7d4c-f118-4006-9e5d-266ee63a18e5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:30.043257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837af7c-2924-418a-a151-5467ae058554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:30.043901 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837af7c-2924-418a-a151-5467ae058554 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:30.044176 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837af7c-2924-418a-a151-5467ae058554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:30.044444 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837af7c-2924-418a-a151-5467ae058554 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:30.045114 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837af7c-2924-418a-a151-5467ae058554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:30.047025 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837af7c-2924-418a-a151-5467ae058554 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:30.076825 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1365/2767] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:29 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:17:30.081209 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722d888-c49f-4f08-862e-829e7a94f9b8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:30.092214 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722d888-c49f-4f08-862e-829e7a94f9b8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:30.097650 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b651e-6df5-4a2f-bc62-38ae4b72602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:30.098254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b651e-6df5-4a2f-bc62-38ae4b72602a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:30.098534 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b651e-6df5-4a2f-bc62-38ae4b72602a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:30.098805 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b651e-6df5-4a2f-bc62-38ae4b72602a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:30.099479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b651e-6df5-4a2f-bc62-38ae4b72602a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:30.101073 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b651e-6df5-4a2f-bc62-38ae4b72602a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:30.112171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1403/2768] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:30.116449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837af7c-2924-418a-a151-5467ae058554 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:30.129723 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837af7c-2924-418a-a151-5467ae058554 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:30.137733 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df210198-899a-4c81-bcc3-e472f53dc0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:30.138370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df210198-899a-4c81-bcc3-e472f53dc0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:30.138769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df210198-899a-4c81-bcc3-e472f53dc0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:30.139038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df210198-899a-4c81-bcc3-e472f53dc0c3 admin admin] PATH_INFO: `/v3/projects/8ed25d80841e4cf8b5a206920fe22f2d/users/9146f9b05dcb48be8c3e55235602e718/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:30.158129 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df210198-899a-4c81-bcc3-e472f53dc0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed25d80841e4cf8b5a206920fe22f2d, user_id=9146f9b05dcb48be8c3e55235602e718, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:30.160807 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df210198-899a-4c81-bcc3-e472f53dc0c3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:30.175354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1366/2769] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:30 2022] PUT /identity/v3/projects/8ed25d80841e4cf8b5a206920fe22f2d/users/9146f9b05dcb48be8c3e55235602e718/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:30.179473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b651e-6df5-4a2f-bc62-38ae4b72602a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:30.190004 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b651e-6df5-4a2f-bc62-38ae4b72602a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:30.250199 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd470482-c8e6-4944-a907-29529a606022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:30.250806 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd470482-c8e6-4944-a907-29529a606022 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:30.251086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd470482-c8e6-4944-a907-29529a606022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:30.251360 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd470482-c8e6-4944-a907-29529a606022 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:30.251997 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd470482-c8e6-4944-a907-29529a606022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:30.253637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd470482-c8e6-4944-a907-29529a606022 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:30.263181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1404/2770] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:30.267591 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df210198-899a-4c81-bcc3-e472f53dc0c3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:30.278680 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df210198-899a-4c81-bcc3-e472f53dc0c3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:30.284108 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1ae5-e1c2-4d5b-a292-0d44b64b6833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:30.284769 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1ae5-e1c2-4d5b-a292-0d44b64b6833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:30.285078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1ae5-e1c2-4d5b-a292-0d44b64b6833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:30.285335 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a1ae5-e1c2-4d5b-a292-0d44b64b6833 admin admin] PATH_INFO: `/v3/projects/8ed25d80841e4cf8b5a206920fe22f2d/users/9146f9b05dcb48be8c3e55235602e718/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:30.287314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a1ae5-e1c2-4d5b-a292-0d44b64b6833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed25d80841e4cf8b5a206920fe22f2d, user_id=9146f9b05dcb48be8c3e55235602e718, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:30.289996 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a1ae5-e1c2-4d5b-a292-0d44b64b6833 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:30.300252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1367/2771] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:30 2022] PUT /identity/v3/projects/8ed25d80841e4cf8b5a206920fe22f2d/users/9146f9b05dcb48be8c3e55235602e718/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:30.317880 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca405de5-9944-4f1b-9944-b6b24c7a16f2 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:30.318134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca405de5-9944-4f1b-9944-b6b24c7a16f2 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:30.318505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca405de5-9944-4f1b-9944-b6b24c7a16f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:30.349428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-ca405de5-9944-4f1b-9944-b6b24c7a16f2 None None] MFA Rules not processed for user `9146f9b05dcb48be8c3e55235602e718`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:30.350673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ca405de5-9944-4f1b-9944-b6b24c7a16f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:30.427450 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1405/2772] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:30.440274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1ae5-e1c2-4d5b-a292-0d44b64b6833 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:30.443229 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a72a1ae5-e1c2-4d5b-a292-0d44b64b6833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:30.505788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a1ae5-e1c2-4d5b-a292-0d44b64b6833 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:30.509945 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388ed82-61b8-479b-93b0-094106d19b69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:30.510625 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388ed82-61b8-479b-93b0-094106d19b69 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:30.510894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388ed82-61b8-479b-93b0-094106d19b69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:30.511163 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388ed82-61b8-479b-93b0-094106d19b69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:30.531685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:30.577487 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388ed82-61b8-479b-93b0-094106d19b69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:30.578865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388ed82-61b8-479b-93b0-094106d19b69 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:30.587870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1368/2773] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:32.133009 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca405de5-9944-4f1b-9944-b6b24c7a16f2 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:32.134752 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-ca405de5-9944-4f1b-9944-b6b24c7a16f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:32.147886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca405de5-9944-4f1b-9944-b6b24c7a16f2 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:32.152280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eda540-806d-4408-94d5-41b1644a7273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:32.152978 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eda540-806d-4408-94d5-41b1644a7273 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:32.153357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eda540-806d-4408-94d5-41b1644a7273 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:32.153700 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eda540-806d-4408-94d5-41b1644a7273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:32.192641 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:32.212728 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eda540-806d-4408-94d5-41b1644a7273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:32.214322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eda540-806d-4408-94d5-41b1644a7273 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:32.223461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1406/2774] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:32.756453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388ed82-61b8-479b-93b0-094106d19b69 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:32.765911 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388ed82-61b8-479b-93b0-094106d19b69 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:32.770432 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586698a5-703c-44f8-8f34-c98467e95189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:32.771039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586698a5-703c-44f8-8f34-c98467e95189 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:32.771319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586698a5-703c-44f8-8f34-c98467e95189 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:32.771592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586698a5-703c-44f8-8f34-c98467e95189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:32.780888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586698a5-703c-44f8-8f34-c98467e95189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:32.782352 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586698a5-703c-44f8-8f34-c98467e95189 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:32.792221 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1369/2775] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:36.710003 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eda540-806d-4408-94d5-41b1644a7273 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:36.775281 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eda540-806d-4408-94d5-41b1644a7273 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:36.780706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:36.781366 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:36.781644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:36.781939 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] PATH_INFO: `/v3/users/7f48405bd5734d5992446cf09bf5dea9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:36.783078 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f48405bd5734d5992446cf09bf5dea9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:36.784997 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:36.835184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f48405bd5734d5992446cf09bf5dea9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:36.835839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f48405bd5734d5992446cf09bf5dea9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:36.861799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f48405bd5734d5992446cf09bf5dea9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:36.874877 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f48405bd5734d5992446cf09bf5dea9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:36.875691 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f48405bd5734d5992446cf09bf5dea9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:36.888622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1407/2776] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:36 2022] DELETE /identity/v3/users/7f48405bd5734d5992446cf09bf5dea9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:36.893202 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252936d-ae86-46cd-9352-25b2939d26a9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:36.893705 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252936d-ae86-46cd-9352-25b2939d26a9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:36.893821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252936d-ae86-46cd-9352-25b2939d26a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:36.912762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9252936d-ae86-46cd-9352-25b2939d26a9 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:36.913994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9252936d-ae86-46cd-9352-25b2939d26a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:36.975801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1370/2777] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:36.986338 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:36.987866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:37.049087 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bba9c-a3e6-45b2-bfb4-1363ff264065 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:37.053548 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bfe18-48d8-4672-876e-e83a9ef8e75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:37.054148 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bfe18-48d8-4672-876e-e83a9ef8e75e service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:37.054425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bfe18-48d8-4672-876e-e83a9ef8e75e service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:37.054694 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bfe18-48d8-4672-876e-e83a9ef8e75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:37.064348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bfe18-48d8-4672-876e-e83a9ef8e75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:37.065837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bfe18-48d8-4672-876e-e83a9ef8e75e service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:37.070858 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:37.075976 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1408/2778] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:37.354101 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252936d-ae86-46cd-9352-25b2939d26a9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:37.355754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9252936d-ae86-46cd-9352-25b2939d26a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:37.370007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252936d-ae86-46cd-9352-25b2939d26a9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:37.376525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:37.377845 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:37.378292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:37.378565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] PATH_INFO: `/v3/projects/65524148a2b54d10b0da46fceda5aa1a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:37.379789 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=65524148a2b54d10b0da46fceda5aa1a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:37.381758 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:37.433262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65524148a2b54d10b0da46fceda5aa1a', 'request_id': 'req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:37.439321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65524148a2b54d10b0da46fceda5aa1a', 'request_id': 'req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:37.447884 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65524148a2b54d10b0da46fceda5aa1a', 'request_id': 'req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:37.459119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] The token cache is being invalidate because project 65524148a2b54d10b0da46fceda5aa1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:37.459407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:37.460093 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:37.461670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1371/2779] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:37 2022] DELETE /identity/v3/projects/65524148a2b54d10b0da46fceda5aa1a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:37.465799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bfe18-48d8-4672-876e-e83a9ef8e75e service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:37.475544 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bfe18-48d8-4672-876e-e83a9ef8e75e service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:37.534275 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:37.534912 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:37.535191 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:37.535466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] PATH_INFO: `/v3/users/8dfb2f9f59a645bbb28b3bae42e470f7` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:37.536754 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dfb2f9f59a645bbb28b3bae42e470f7)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:37.538750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:37.589213 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dfb2f9f59a645bbb28b3bae42e470f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:37.589882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dfb2f9f59a645bbb28b3bae42e470f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:37.602033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dfb2f9f59a645bbb28b3bae42e470f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:37.611185 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dfb2f9f59a645bbb28b3bae42e470f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:37.611887 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dfb2f9f59a645bbb28b3bae42e470f7'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:37.624739 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1409/2780] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:37 2022] DELETE /identity/v3/users/8dfb2f9f59a645bbb28b3bae42e470f7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:37.907276 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:37.908840 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:37.922635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a01b08-4993-4b3c-a8f6-f7a34a211b9e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:37.954891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:37.982660 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:37.983299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:37.983580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:37.983849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] PATH_INFO: `/v3/projects/a1e3b887e5484ea1be13221a59c0ae8e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:37.985023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e3b887e5484ea1be13221a59c0ae8e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:37.986977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:38.037073 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e3b887e5484ea1be13221a59c0ae8e', 'request_id': 'req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.043078 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e3b887e5484ea1be13221a59c0ae8e', 'request_id': 'req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.051396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e3b887e5484ea1be13221a59c0ae8e', 'request_id': 'req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.062779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] The token cache is being invalidate because project a1e3b887e5484ea1be13221a59c0ae8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:38.063067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.063681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.065169 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1372/2781] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:37 2022] DELETE /identity/v3/projects/a1e3b887e5484ea1be13221a59c0ae8e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:38.069419 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:38.070892 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:38.083773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbcc87-8d81-4d17-9ac1-79b3c1bb8e87 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:38.145115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:38.145748 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:38.146035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:38.146300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] PATH_INFO: `/v3/users/9146f9b05dcb48be8c3e55235602e718` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:38.147508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9146f9b05dcb48be8c3e55235602e718)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:38.150252 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:38.173312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:38.204740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9146f9b05dcb48be8c3e55235602e718'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.205528 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9146f9b05dcb48be8c3e55235602e718'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.218773 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9146f9b05dcb48be8c3e55235602e718'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.227306 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9146f9b05dcb48be8c3e55235602e718'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.227913 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-203d9fc6-4ff4-4acf-bceb-39c3328340f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9146f9b05dcb48be8c3e55235602e718'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.241814 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1410/2782] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:17:38 2022] DELETE /identity/v3/users/9146f9b05dcb48be8c3e55235602e718 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:38.538006 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:38.539799 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:38.558254 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccfaf1-7baa-41c4-9c6b-41bd8095f4b4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:38.613065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:38.613709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:38.613987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:38.614256 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] PATH_INFO: `/v3/projects/8ed25d80841e4cf8b5a206920fe22f2d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:38.615346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed25d80841e4cf8b5a206920fe22f2d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:38.617311 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:38.664446 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed25d80841e4cf8b5a206920fe22f2d', 'request_id': 'req-c7800052-c306-4b94-a20b-8d8cfe9be5d4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.670672 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed25d80841e4cf8b5a206920fe22f2d', 'request_id': 'req-c7800052-c306-4b94-a20b-8d8cfe9be5d4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.679472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed25d80841e4cf8b5a206920fe22f2d', 'request_id': 'req-c7800052-c306-4b94-a20b-8d8cfe9be5d4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.680844 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:38.693410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] The token cache is being invalidate because project 8ed25d80841e4cf8b5a206920fe22f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:17:38.693710 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.694561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c7800052-c306-4b94-a20b-8d8cfe9be5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:17:38.696208 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1373/2783] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:17:38 2022] DELETE /identity/v3/projects/8ed25d80841e4cf8b5a206920fe22f2d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:38.701425 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2676-f0d4-445c-b963-e70a7303cc6f None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:38.701740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2676-f0d4-445c-b963-e70a7303cc6f None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:38.702015 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f2676-f0d4-445c-b963-e70a7303cc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:38.725683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-767f2676-f0d4-445c-b963-e70a7303cc6f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:38.727484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-767f2676-f0d4-445c-b963-e70a7303cc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:38.792039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1411/2784] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:38.800244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bedae-b227-48ea-ae1b-86556845ace6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:38.800531 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bedae-b227-48ea-ae1b-86556845ace6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:38.800808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bedae-b227-48ea-ae1b-86556845ace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:38.823952 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c38bedae-b227-48ea-ae1b-86556845ace6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:38.825233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c38bedae-b227-48ea-ae1b-86556845ace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:38.834353 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1374/2785] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:38.840971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f2676-f0d4-445c-b963-e70a7303cc6f None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:38.851437 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f2676-f0d4-445c-b963-e70a7303cc6f None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:38.856898 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25966456-ff87-4b88-923d-db495a1e3058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:38.857526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25966456-ff87-4b88-923d-db495a1e3058 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:38.857807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25966456-ff87-4b88-923d-db495a1e3058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:38.858076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25966456-ff87-4b88-923d-db495a1e3058 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:38.858732 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25966456-ff87-4b88-923d-db495a1e3058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:17:38.859031 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25966456-ff87-4b88-923d-db495a1e3058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:38.860649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25966456-ff87-4b88-923d-db495a1e3058 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:38.872460 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1412/2786] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:17:38.877286 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bedae-b227-48ea-ae1b-86556845ace6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:38.886892 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bedae-b227-48ea-ae1b-86556845ace6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:38.891957 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f215fe-a1c0-4175-a232-2fe63baea1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:38.892553 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f215fe-a1c0-4175-a232-2fe63baea1bc admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:38.892833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f215fe-a1c0-4175-a232-2fe63baea1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:38.893128 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f215fe-a1c0-4175-a232-2fe63baea1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:38.893762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f215fe-a1c0-4175-a232-2fe63baea1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:38.895670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f215fe-a1c0-4175-a232-2fe63baea1bc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:38.927853 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1375/2787] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:17:38 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:38.932296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25966456-ff87-4b88-923d-db495a1e3058 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:38.942849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25966456-ff87-4b88-923d-db495a1e3058 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:39.000575 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c28b-afb2-40b0-a387-dca9dfec4339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:39.001232 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c28b-afb2-40b0-a387-dca9dfec4339 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:39.001505 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c28b-afb2-40b0-a387-dca9dfec4339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:39.001774 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c28b-afb2-40b0-a387-dca9dfec4339 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:39.002431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719c28b-afb2-40b0-a387-dca9dfec4339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:39.004359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719c28b-afb2-40b0-a387-dca9dfec4339 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:39.027783 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1413/2788] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:17:38 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:17:39.032230 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f215fe-a1c0-4175-a232-2fe63baea1bc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:39.042808 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f215fe-a1c0-4175-a232-2fe63baea1bc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:39.047540 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d15f-33ac-4960-bd90-f79844fe1039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:39.048128 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d15f-33ac-4960-bd90-f79844fe1039 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:39.048403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d15f-33ac-4960-bd90-f79844fe1039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:39.048667 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056d15f-33ac-4960-bd90-f79844fe1039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:39.049339 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056d15f-33ac-4960-bd90-f79844fe1039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:39.050915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056d15f-33ac-4960-bd90-f79844fe1039 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:39.060794 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1376/2789] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:17:39.064696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c28b-afb2-40b0-a387-dca9dfec4339 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:39.075067 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c28b-afb2-40b0-a387-dca9dfec4339 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:39.080192 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323c6b4-5fc9-4c7b-a63e-70efde0730ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:39.080792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323c6b4-5fc9-4c7b-a63e-70efde0730ce admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:39.081075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323c6b4-5fc9-4c7b-a63e-70efde0730ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:39.081363 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323c6b4-5fc9-4c7b-a63e-70efde0730ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:39.082033 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323c6b4-5fc9-4c7b-a63e-70efde0730ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:39.083630 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323c6b4-5fc9-4c7b-a63e-70efde0730ce admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:39.094132 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1414/2790] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:17:39.098180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d15f-33ac-4960-bd90-f79844fe1039 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:39.108047 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056d15f-33ac-4960-bd90-f79844fe1039 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:39.112981 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a185cf-936a-4274-a12b-f440464dfebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:39.113638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a185cf-936a-4274-a12b-f440464dfebf admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:39.113912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a185cf-936a-4274-a12b-f440464dfebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:39.114175 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a185cf-936a-4274-a12b-f440464dfebf admin admin] PATH_INFO: `/v3/projects/48ed8f2c87484bfba3c2229458474683/users/ae8a53b16134453a8a924222623e9a85/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:39.129184 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a185cf-936a-4274-a12b-f440464dfebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ed8f2c87484bfba3c2229458474683, user_id=ae8a53b16134453a8a924222623e9a85, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:39.131820 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a185cf-936a-4274-a12b-f440464dfebf admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:39.147676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1377/2791] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:17:39 2022] PUT /identity/v3/projects/48ed8f2c87484bfba3c2229458474683/users/ae8a53b16134453a8a924222623e9a85/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:17:39.152840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab135ce-8387-4109-bded-33fb52cb8cfa None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:39.153179 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab135ce-8387-4109-bded-33fb52cb8cfa None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:39.153508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab135ce-8387-4109-bded-33fb52cb8cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:39.162300 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:39.174562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bab135ce-8387-4109-bded-33fb52cb8cfa None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:39.176187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bab135ce-8387-4109-bded-33fb52cb8cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:39.237421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1415/2792] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:39.250552 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a185cf-936a-4274-a12b-f440464dfebf admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:39.252626 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-56a185cf-936a-4274-a12b-f440464dfebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:39.320292 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a185cf-936a-4274-a12b-f440464dfebf admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:39.324969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a093288-7819-4fe7-bbc7-5d883526fc99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:39.325624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a093288-7819-4fe7-bbc7-5d883526fc99 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:39.325971 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a093288-7819-4fe7-bbc7-5d883526fc99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:39.326251 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a093288-7819-4fe7-bbc7-5d883526fc99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:39.336606 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a093288-7819-4fe7-bbc7-5d883526fc99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:39.338127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a093288-7819-4fe7-bbc7-5d883526fc99 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:39.348405 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1378/2793] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:39.986236 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89aa88-3244-41de-b297-be03c9910a2a None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:39.986675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89aa88-3244-41de-b297-be03c9910a2a None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:39.987045 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89aa88-3244-41de-b297-be03c9910a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:40.017114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-2f89aa88-3244-41de-b297-be03c9910a2a None None] MFA Rules not processed for user `ae8a53b16134453a8a924222623e9a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:40.018375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-2f89aa88-3244-41de-b297-be03c9910a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:40.087813 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1416/2794] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:40.099085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a093288-7819-4fe7-bbc7-5d883526fc99 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:40.100522 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9a093288-7819-4fe7-bbc7-5d883526fc99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:40.160257 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a093288-7819-4fe7-bbc7-5d883526fc99 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:40.164063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd47449-9b87-4775-93cd-0954f31e2bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:40.164674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd47449-9b87-4775-93cd-0954f31e2bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:40.164951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd47449-9b87-4775-93cd-0954f31e2bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:40.165255 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd47449-9b87-4775-93cd-0954f31e2bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:40.174327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd47449-9b87-4775-93cd-0954f31e2bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:40.175763 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd47449-9b87-4775-93cd-0954f31e2bb3 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:40.184519 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1379/2795] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:41.566675 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dbf19-ec22-4c47-ad65-726be308e009 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:41.567248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dbf19-ec22-4c47-ad65-726be308e009 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:41.567248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dbf19-ec22-4c47-ad65-726be308e009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:41.588521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-727dbf19-ec22-4c47-ad65-726be308e009 None None] MFA Rules not processed for user `ae8a53b16134453a8a924222623e9a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:41.589771 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-727dbf19-ec22-4c47-ad65-726be308e009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:41.598414 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1417/2796] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:17:41.840984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd47449-9b87-4775-93cd-0954f31e2bb3 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:17:41.843261 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dfd47449-9b87-4775-93cd-0954f31e2bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:41.857181 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd47449-9b87-4775-93cd-0954f31e2bb3 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:17:41.861466 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70207e-12e1-4f4a-a204-887ccbfd36db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:17:41.862067 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70207e-12e1-4f4a-a204-887ccbfd36db service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:41.862342 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70207e-12e1-4f4a-a204-887ccbfd36db service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:41.862609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70207e-12e1-4f4a-a204-887ccbfd36db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:41.864771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1d70207e-12e1-4f4a-a204-887ccbfd36db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:41.876017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70207e-12e1-4f4a-a204-887ccbfd36db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:17:41.877599 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70207e-12e1-4f4a-a204-887ccbfd36db service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:17:41.885542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1380/2797] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:17:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:17:51.584810 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=60 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:51.881961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:17:57.239483 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de38e3-b04a-49e6-bc8e-fe670c5fa1df None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:17:57.239970 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de38e3-b04a-49e6-bc8e-fe670c5fa1df None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:17:57.240068 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de38e3-b04a-49e6-bc8e-fe670c5fa1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:17:57.260598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-34de38e3-b04a-49e6-bc8e-fe670c5fa1df None None] MFA Rules not processed for user `ae8a53b16134453a8a924222623e9a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:17:57.261870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-34de38e3-b04a-49e6-bc8e-fe670c5fa1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:17:57.270146 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1418/2798] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:17:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:18:03.664926 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a376b3-adbc-40f7-b4cc-c3dbed213a05 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:03.665533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a376b3-adbc-40f7-b4cc-c3dbed213a05 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:03.665533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a376b3-adbc-40f7-b4cc-c3dbed213a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:03.696146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-90a376b3-adbc-40f7-b4cc-c3dbed213a05 None None] MFA Rules not processed for user `d2cd08c0e3194e4cbb60925fa1332ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:18:03.697401 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-90a376b3-adbc-40f7-b4cc-c3dbed213a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:03.771280 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1381/2799] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:18:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:18:07.255332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:18:11.174071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de38e3-b04a-49e6-bc8e-fe670c5fa1df None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:11.175775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-34de38e3-b04a-49e6-bc8e-fe670c5fa1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:11.354075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de38e3-b04a-49e6-bc8e-fe670c5fa1df None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:11.360089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b59e7-501e-4ede-9dc5-4ddb35d6a9dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4716f9539151414dadd9e4b8f13ffc0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:11.360750 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b59e7-501e-4ede-9dc5-4ddb35d6a9dd service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:11.361016 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b59e7-501e-4ede-9dc5-4ddb35d6a9dd service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:11.361292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b59e7-501e-4ede-9dc5-4ddb35d6a9dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:11.363263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-296b59e7-501e-4ede-9dc5-4ddb35d6a9dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:11.375647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b59e7-501e-4ede-9dc5-4ddb35d6a9dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:11.377277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b59e7-501e-4ede-9dc5-4ddb35d6a9dd service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:11.387699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1419/2800] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:18:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:18:13.769295 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=37 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:18:14.190891 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7c2bc-22fd-4d0a-a5f8-c197f65fa153 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:14.191187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7c2bc-22fd-4d0a-a5f8-c197f65fa153 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:14.191462 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7c2bc-22fd-4d0a-a5f8-c197f65fa153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:14.221617 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5ea7c2bc-22fd-4d0a-a5f8-c197f65fa153 None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:18:14.222877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5ea7c2bc-22fd-4d0a-a5f8-c197f65fa153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:14.289210 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1382/2801] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Sep 19 17:18:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:18:14.336503 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b59e7-501e-4ede-9dc5-4ddb35d6a9dd service placement] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:14.338438 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-296b59e7-501e-4ede-9dc5-4ddb35d6a9dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:14.416026 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b59e7-501e-4ede-9dc5-4ddb35d6a9dd service placement] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:14.423099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccefddd-3c39-4d87-92ba-7ac16b70d88f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:14.423798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccefddd-3c39-4d87-92ba-7ac16b70d88f service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:14.424144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccefddd-3c39-4d87-92ba-7ac16b70d88f service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:14.424481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccefddd-3c39-4d87-92ba-7ac16b70d88f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:14.433487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccefddd-3c39-4d87-92ba-7ac16b70d88f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:14.435094 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccefddd-3c39-4d87-92ba-7ac16b70d88f service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:14.444193 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1420/2802] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:18:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:18:24.282231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=32 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:18:24.440706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:18:29.922091 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf6d0-244c-4109-9999-16bfe1fdd81c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:29.922597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf6d0-244c-4109-9999-16bfe1fdd81c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:29.922597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf6d0-244c-4109-9999-16bfe1fdd81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:29.942666 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-15ecf6d0-244c-4109-9999-16bfe1fdd81c None None] MFA Rules not processed for user `ee58334347c34e329ac250ae9e73aa93`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:18:29.943899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-15ecf6d0-244c-4109-9999-16bfe1fdd81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:29.951943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1383/2803] 10.222.0.76 () {58 vars in 967 bytes} [Mon Sep 19 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:18:29.964348 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccefddd-3c39-4d87-92ba-7ac16b70d88f service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:29.975652 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccefddd-3c39-4d87-92ba-7ac16b70d88f service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:29.981195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef60ef0-b6a8-48fd-8e06-1ed2ed6f924b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8834ef19c2604e8c828aa4dd32db61a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:29.981799 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef60ef0-b6a8-48fd-8e06-1ed2ed6f924b service swift] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:29.982344 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef60ef0-b6a8-48fd-8e06-1ed2ed6f924b service swift] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:29.982576 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef60ef0-b6a8-48fd-8e06-1ed2ed6f924b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:29.991526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef60ef0-b6a8-48fd-8e06-1ed2ed6f924b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:29.993927 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef60ef0-b6a8-48fd-8e06-1ed2ed6f924b service swift] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:30.003376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1421/2804] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Sep 19 17:18:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 17:18:32.028570 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf6d0-244c-4109-9999-16bfe1fdd81c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:32.059676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf6d0-244c-4109-9999-16bfe1fdd81c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:32.064240 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:32.064864 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:32.065193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:32.065490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] PATH_INFO: `/v3/users/ae8a53b16134453a8a924222623e9a85` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:32.066609 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8a53b16134453a8a924222623e9a85)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:32.068521 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:32.116022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8a53b16134453a8a924222623e9a85'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:32.123162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8a53b16134453a8a924222623e9a85'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:32.123811 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8a53b16134453a8a924222623e9a85'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:32.135673 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8a53b16134453a8a924222623e9a85'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:32.136451 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-308cc5c3-722d-42c3-8f46-423082c62b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8a53b16134453a8a924222623e9a85'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:32.154357 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1384/2805] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:18:32 2022] DELETE /identity/v3/users/ae8a53b16134453a8a924222623e9a85 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:18:32.357521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef60ef0-b6a8-48fd-8e06-1ed2ed6f924b service swift] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:32.371606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef60ef0-b6a8-48fd-8e06-1ed2ed6f924b service swift] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:32.437164 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:32.437792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:32.438071 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:32.438341 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] PATH_INFO: `/v3/projects/48ed8f2c87484bfba3c2229458474683` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:32.439637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ed8f2c87484bfba3c2229458474683)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:32.441643 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:32.488904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ed8f2c87484bfba3c2229458474683', 'request_id': 'req-41d16486-5afb-4f3e-8c2e-20d666130f15'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:32.494744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ed8f2c87484bfba3c2229458474683', 'request_id': 'req-41d16486-5afb-4f3e-8c2e-20d666130f15'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:32.503511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ed8f2c87484bfba3c2229458474683', 'request_id': 'req-41d16486-5afb-4f3e-8c2e-20d666130f15'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:32.526566 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] The token cache is being invalidate because project 48ed8f2c87484bfba3c2229458474683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:18:32.526789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:32.527435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-41d16486-5afb-4f3e-8c2e-20d666130f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:32.528968 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1422/2806] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:18:32 2022] DELETE /identity/v3/projects/48ed8f2c87484bfba3c2229458474683 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:18:32.534139 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af68f6-573a-4e6f-a410-cc420c42a166 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:32.534437 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af68f6-573a-4e6f-a410-cc420c42a166 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:32.534714 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af68f6-573a-4e6f-a410-cc420c42a166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:32.593485 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f9af68f6-573a-4e6f-a410-cc420c42a166 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:18:32.594729 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f9af68f6-573a-4e6f-a410-cc420c42a166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:32.670675 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1385/2807] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:18:32.678598 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940bbb5-4bf9-401f-8ab8-5d3ad751a9f8 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:32.678888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940bbb5-4bf9-401f-8ab8-5d3ad751a9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:32.679162 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940bbb5-4bf9-401f-8ab8-5d3ad751a9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:32.702204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-c940bbb5-4bf9-401f-8ab8-5d3ad751a9f8 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:18:32.704115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-c940bbb5-4bf9-401f-8ab8-5d3ad751a9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:32.717644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1423/2808] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:18:32.721998 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af68f6-573a-4e6f-a410-cc420c42a166 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:32.732023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af68f6-573a-4e6f-a410-cc420c42a166 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:32.738002 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e23413-7f6c-46be-9e68-e647277139ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:32.738604 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e23413-7f6c-46be-9e68-e647277139ac admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:32.738875 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e23413-7f6c-46be-9e68-e647277139ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:32.739144 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e23413-7f6c-46be-9e68-e647277139ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:32.739798 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e23413-7f6c-46be-9e68-e647277139ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:18:32.740097 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e23413-7f6c-46be-9e68-e647277139ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:32.741748 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e23413-7f6c-46be-9e68-e647277139ac admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:32.754096 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1386/2809] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:18:32.758608 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940bbb5-4bf9-401f-8ab8-5d3ad751a9f8 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:32.768088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940bbb5-4bf9-401f-8ab8-5d3ad751a9f8 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:32.773600 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dce37-6a8e-4d52-aafe-7ac5ccb56eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:32.774200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dce37-6a8e-4d52-aafe-7ac5ccb56eca admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:32.774482 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dce37-6a8e-4d52-aafe-7ac5ccb56eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:32.774735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dce37-6a8e-4d52-aafe-7ac5ccb56eca admin admin] PATH_INFO: `/v3/projects` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:32.775385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dce37-6a8e-4d52-aafe-7ac5ccb56eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:32.777399 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dce37-6a8e-4d52-aafe-7ac5ccb56eca admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:32.806491 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1424/2810] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:18:32 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:18:32.810668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e23413-7f6c-46be-9e68-e647277139ac admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:32.821849 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e23413-7f6c-46be-9e68-e647277139ac admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:32.825767 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:18:32.882928 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13c4d5-8365-4ee0-a181-9b5a5f7689cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:32.883533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13c4d5-8365-4ee0-a181-9b5a5f7689cb admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:32.883813 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13c4d5-8365-4ee0-a181-9b5a5f7689cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:32.884085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13c4d5-8365-4ee0-a181-9b5a5f7689cb admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:32.884721 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13c4d5-8365-4ee0-a181-9b5a5f7689cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:32.886686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13c4d5-8365-4ee0-a181-9b5a5f7689cb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:32.910788 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1387/2811] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:18:32 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:18:32.916099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dce37-6a8e-4d52-aafe-7ac5ccb56eca admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:32.927087 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dce37-6a8e-4d52-aafe-7ac5ccb56eca admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:32.932484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe78113-801b-4b81-8c68-cb6b7864f53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:32.933115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe78113-801b-4b81-8c68-cb6b7864f53f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:32.933381 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe78113-801b-4b81-8c68-cb6b7864f53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:32.933647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe78113-801b-4b81-8c68-cb6b7864f53f admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:32.934287 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe78113-801b-4b81-8c68-cb6b7864f53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:32.935886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe78113-801b-4b81-8c68-cb6b7864f53f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:32.945839 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1425/2812] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:18:32.949743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13c4d5-8365-4ee0-a181-9b5a5f7689cb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:32.959854 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13c4d5-8365-4ee0-a181-9b5a5f7689cb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:32.964912 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337eabe-85ea-4f89-81cc-b3b53885ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:32.965533 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337eabe-85ea-4f89-81cc-b3b53885ffc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:32.965815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337eabe-85ea-4f89-81cc-b3b53885ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:32.966086 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337eabe-85ea-4f89-81cc-b3b53885ffc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:32.966742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337eabe-85ea-4f89-81cc-b3b53885ffc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:32.968333 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337eabe-85ea-4f89-81cc-b3b53885ffc7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:32.980007 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1388/2813] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:18:32.984181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe78113-801b-4b81-8c68-cb6b7864f53f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:32.994942 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe78113-801b-4b81-8c68-cb6b7864f53f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:33.000044 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714a9f6-e4b6-48ff-b8bf-ecb7166f0c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:33.000691 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714a9f6-e4b6-48ff-b8bf-ecb7166f0c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:33.000972 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714a9f6-e4b6-48ff-b8bf-ecb7166f0c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:33.001277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714a9f6-e4b6-48ff-b8bf-ecb7166f0c8c admin admin] PATH_INFO: `/v3/projects/6958ae765f3b4e80968645ca7b593be5/users/475860bf72574587addb58008e2d1307/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:33.016372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714a9f6-e4b6-48ff-b8bf-ecb7166f0c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6958ae765f3b4e80968645ca7b593be5, user_id=475860bf72574587addb58008e2d1307, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:33.019061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714a9f6-e4b6-48ff-b8bf-ecb7166f0c8c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:33.034666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1426/2814] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:18:32 2022] PUT /identity/v3/projects/6958ae765f3b4e80968645ca7b593be5/users/475860bf72574587addb58008e2d1307/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:18:33.050155 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01041-b859-4cc1-84ae-dfcda15cf640 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:33.050647 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01041-b859-4cc1-84ae-dfcda15cf640 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:33.050754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c01041-b859-4cc1-84ae-dfcda15cf640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:33.080476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c7c01041-b859-4cc1-84ae-dfcda15cf640 None None] MFA Rules not processed for user `475860bf72574587addb58008e2d1307`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:18:33.081715 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c7c01041-b859-4cc1-84ae-dfcda15cf640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:33.155544 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1389/2815] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:18:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:18:33.167315 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714a9f6-e4b6-48ff-b8bf-ecb7166f0c8c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:33.169164 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6714a9f6-e4b6-48ff-b8bf-ecb7166f0c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:33.173260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:18:33.250789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714a9f6-e4b6-48ff-b8bf-ecb7166f0c8c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:33.255239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139de4-431f-4894-a5b8-467a4909aebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:33.255845 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139de4-431f-4894-a5b8-467a4909aebe service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:33.256124 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139de4-431f-4894-a5b8-467a4909aebe service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:33.256392 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139de4-431f-4894-a5b8-467a4909aebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:33.265373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139de4-431f-4894-a5b8-467a4909aebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:33.266811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139de4-431f-4894-a5b8-467a4909aebe service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:33.275928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1427/2816] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:18:33 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:18:38.343654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c01041-b859-4cc1-84ae-dfcda15cf640 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:38.411754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c01041-b859-4cc1-84ae-dfcda15cf640 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:38.416888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:38.417523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:38.417801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:38.418074 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] PATH_INFO: `/v3/users/475860bf72574587addb58008e2d1307` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:38.419262 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] RBAC: Authorizing `identity:delete_user(user_id=475860bf72574587addb58008e2d1307)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:38.421222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:38.437189 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:18:38.468762 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '475860bf72574587addb58008e2d1307'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:38.476089 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '475860bf72574587addb58008e2d1307'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:38.476801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '475860bf72574587addb58008e2d1307'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:38.486327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '475860bf72574587addb58008e2d1307'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:38.486993 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '475860bf72574587addb58008e2d1307'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:38.506781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1390/2817] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:18:38 2022] DELETE /identity/v3/users/475860bf72574587addb58008e2d1307 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:18:38.511532 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909840d-2e38-4da9-8276-3602d5c8e0b6 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:38.512011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909840d-2e38-4da9-8276-3602d5c8e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:38.512114 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909840d-2e38-4da9-8276-3602d5c8e0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:38.532051 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8909840d-2e38-4da9-8276-3602d5c8e0b6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:18:38.533471 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8909840d-2e38-4da9-8276-3602d5c8e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:38.594418 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1428/2818] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:18:38.604709 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:38.606299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:38.690069 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c1443-e32c-4ae2-96d7-63ba4590129e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:38.694894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01731c2d-e6fb-4645-80b8-8a3f12977e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:38.695492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01731c2d-e6fb-4645-80b8-8a3f12977e8b service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:38.695779 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01731c2d-e6fb-4645-80b8-8a3f12977e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:38.696107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01731c2d-e6fb-4645-80b8-8a3f12977e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:38.706321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01731c2d-e6fb-4645-80b8-8a3f12977e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:38.707752 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01731c2d-e6fb-4645-80b8-8a3f12977e8b service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:38.717737 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1391/2819] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:18:39.005766 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909840d-2e38-4da9-8276-3602d5c8e0b6 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:18:39.007221 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8909840d-2e38-4da9-8276-3602d5c8e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:18:39.021187 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909840d-2e38-4da9-8276-3602d5c8e0b6 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:18:39.027786 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:18:39.028446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:18:39.028808 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:18:39.029086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] PATH_INFO: `/v3/projects/6958ae765f3b4e80968645ca7b593be5` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:18:39.030385 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6958ae765f3b4e80968645ca7b593be5)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:18:39.032439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:18:39.081204 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6958ae765f3b4e80968645ca7b593be5', 'request_id': 'req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:39.087111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6958ae765f3b4e80968645ca7b593be5', 'request_id': 'req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:39.095578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6958ae765f3b4e80968645ca7b593be5', 'request_id': 'req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:39.107110 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] The token cache is being invalidate because project 6958ae765f3b4e80968645ca7b593be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81585) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:18:39.107401 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:39.108111 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:18:39.109744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1429/2820] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:18:39 2022] DELETE /identity/v3/projects/6958ae765f3b4e80968645ca7b593be5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:18:48.713293 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=9,keystone:SELECT=55,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:18:49.103731 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:19:02.003951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2f763-fd7a-4bf8-bcfe-078900d37d32 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:19:02.004520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2f763-fd7a-4bf8-bcfe-078900d37d32 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:19:02.004520 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2f763-fd7a-4bf8-bcfe-078900d37d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:19:02.029277 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9ba2f763-fd7a-4bf8-bcfe-078900d37d32 None None] MFA Rules not processed for user `d2cd08c0e3194e4cbb60925fa1332ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:19:02.030679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9ba2f763-fd7a-4bf8-bcfe-078900d37d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:19:02.086918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1392/2821] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:19:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:19:12.079805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=25 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:05.058104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:05.059744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:05.125048 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62e30b-fb3b-4c09-8c79-6eea59f7a9a8 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:05.130082 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:05.131950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:05.131950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:05.131950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] PATH_INFO: `/v3/users/d2cd08c0e3194e4cbb60925fa1332ab2` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:05.132263 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2cd08c0e3194e4cbb60925fa1332ab2)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:05.134100 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:05.183794 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2cd08c0e3194e4cbb60925fa1332ab2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:05.184497 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2cd08c0e3194e4cbb60925fa1332ab2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:05.196508 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2cd08c0e3194e4cbb60925fa1332ab2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:05.205207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2cd08c0e3194e4cbb60925fa1332ab2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:05.205857 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-e999b034-12a8-4591-ace0-004c340a5092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2cd08c0e3194e4cbb60925fa1332ab2'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:05.218028 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1430/2822] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:20:05 2022] DELETE /identity/v3/users/d2cd08c0e3194e4cbb60925fa1332ab2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:05.400010 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2f763-fd7a-4bf8-bcfe-078900d37d32 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:05.411738 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2f763-fd7a-4bf8-bcfe-078900d37d32 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:05.471980 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:05.472621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:05.472899 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:05.473205 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] PATH_INFO: `/v3/projects/50ae0a701af74c578f92ec213d6909d2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:05.474334 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ae0a701af74c578f92ec213d6909d2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:05.476252 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:05.525436 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ae0a701af74c578f92ec213d6909d2', 'request_id': 'req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:05.531036 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ae0a701af74c578f92ec213d6909d2', 'request_id': 'req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:05.539115 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ae0a701af74c578f92ec213d6909d2', 'request_id': 'req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:05.551455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] The token cache is being invalidate because project 50ae0a701af74c578f92ec213d6909d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:20:05.551744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:05.552377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-559dcdf0-ce8c-4c13-8a39-19dae1e9e46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:05.553918 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1393/2823] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:20:05 2022] DELETE /identity/v3/projects/50ae0a701af74c578f92ec213d6909d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:05.558955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f1e95-2123-4c81-b88c-6903ca02b7ef None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:05.559324 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f1e95-2123-4c81-b88c-6903ca02b7ef None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:05.559666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f1e95-2123-4c81-b88c-6903ca02b7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:05.581649 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-0c2f1e95-2123-4c81-b88c-6903ca02b7ef None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:05.582870 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-0c2f1e95-2123-4c81-b88c-6903ca02b7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:05.642248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1431/2824] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:05.650401 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d629-790a-40ac-9c42-6e1a82490625 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:05.650682 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d629-790a-40ac-9c42-6e1a82490625 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:05.650951 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22d629-790a-40ac-9c42-6e1a82490625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:05.670798 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ff22d629-790a-40ac-9c42-6e1a82490625 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:05.672049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ff22d629-790a-40ac-9c42-6e1a82490625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:05.680049 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1394/2825] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:05.684415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f1e95-2123-4c81-b88c-6903ca02b7ef None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:05.697780 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f1e95-2123-4c81-b88c-6903ca02b7ef None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:05.703635 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372d6cf-69d1-4e54-86a5-c27da71a707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:05.704280 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372d6cf-69d1-4e54-86a5-c27da71a707f admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:05.704564 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372d6cf-69d1-4e54-86a5-c27da71a707f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:05.704837 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372d6cf-69d1-4e54-86a5-c27da71a707f admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:05.705533 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372d6cf-69d1-4e54-86a5-c27da71a707f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:20:05.705841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372d6cf-69d1-4e54-86a5-c27da71a707f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:05.707466 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372d6cf-69d1-4e54-86a5-c27da71a707f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:05.726282 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1432/2826] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:20:05.731223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22d629-790a-40ac-9c42-6e1a82490625 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:05.741266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22d629-790a-40ac-9c42-6e1a82490625 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:05.748852 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5750-d310-4245-ac56-51dcbcd8d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:05.749490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5750-d310-4245-ac56-51dcbcd8d2bb admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:05.749768 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5750-d310-4245-ac56-51dcbcd8d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:05.750095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5750-d310-4245-ac56-51dcbcd8d2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:05.750726 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac5750-d310-4245-ac56-51dcbcd8d2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:05.753490 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac5750-d310-4245-ac56-51dcbcd8d2bb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:05.798195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1395/2827] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:20:05 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:05.802711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372d6cf-69d1-4e54-86a5-c27da71a707f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:05.814254 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372d6cf-69d1-4e54-86a5-c27da71a707f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:05.818137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:05.876664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d02d-2d94-4783-8f94-4952b0285bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:05.877322 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d02d-2d94-4783-8f94-4952b0285bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:05.877602 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d02d-2d94-4783-8f94-4952b0285bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:05.877875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d02d-2d94-4783-8f94-4952b0285bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:05.878504 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23d02d-2d94-4783-8f94-4952b0285bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:05.880433 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23d02d-2d94-4783-8f94-4952b0285bc6 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:05.903476 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1433/2828] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:20:05 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:05.908860 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5750-d310-4245-ac56-51dcbcd8d2bb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:05.919346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5750-d310-4245-ac56-51dcbcd8d2bb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:05.924499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9627d-3741-48d1-9a03-86e2c0540e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:05.925130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9627d-3741-48d1-9a03-86e2c0540e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:05.925407 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9627d-3741-48d1-9a03-86e2c0540e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:05.925681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9627d-3741-48d1-9a03-86e2c0540e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:05.926332 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9627d-3741-48d1-9a03-86e2c0540e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:05.927934 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9627d-3741-48d1-9a03-86e2c0540e64 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:05.938310 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1396/2829] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:05.942565 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d02d-2d94-4783-8f94-4952b0285bc6 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:05.958070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d02d-2d94-4783-8f94-4952b0285bc6 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:05.966627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d84177-b757-4bd2-9086-fd12c42e267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:05.967485 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84177-b757-4bd2-9086-fd12c42e267c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:05.967779 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84177-b757-4bd2-9086-fd12c42e267c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:05.968063 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84177-b757-4bd2-9086-fd12c42e267c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:05.968999 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d84177-b757-4bd2-9086-fd12c42e267c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:05.970646 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d84177-b757-4bd2-9086-fd12c42e267c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:05.981644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1434/2830] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:20:05.985858 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9627d-3741-48d1-9a03-86e2c0540e64 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:05.996641 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9627d-3741-48d1-9a03-86e2c0540e64 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:06.002608 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6aa13-1338-4095-bc13-582132aeea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:06.003304 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6aa13-1338-4095-bc13-582132aeea3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.003583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6aa13-1338-4095-bc13-582132aeea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.003975 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6aa13-1338-4095-bc13-582132aeea3d admin admin] PATH_INFO: `/v3/projects/d0fabedabc394e0da6dad43331d63731/users/bdda79e4a52c427abb6d3d1adfa838f0/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.028972 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6aa13-1338-4095-bc13-582132aeea3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0fabedabc394e0da6dad43331d63731, user_id=bdda79e4a52c427abb6d3d1adfa838f0, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:06.032514 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6aa13-1338-4095-bc13-582132aeea3d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:06.049087 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1397/2831] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:05 2022] PUT /identity/v3/projects/d0fabedabc394e0da6dad43331d63731/users/bdda79e4a52c427abb6d3d1adfa838f0/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:06.064931 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5e80-b6d4-4909-ab77-8fb831e8f656 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.065745 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5e80-b6d4-4909-ab77-8fb831e8f656 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.065745 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc5e80-b6d4-4909-ab77-8fb831e8f656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.103959 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-08dc5e80-b6d4-4909-ab77-8fb831e8f656 None None] MFA Rules not processed for user `bdda79e4a52c427abb6d3d1adfa838f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:06.105701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-08dc5e80-b6d4-4909-ab77-8fb831e8f656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:06.183196 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1435/2832] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:06.188187 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6aa13-1338-4095-bc13-582132aeea3d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:06.210393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:06.254960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6aa13-1338-4095-bc13-582132aeea3d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:06.260619 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b5734-702c-42cc-81bb-8e75b0a5ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:06.261267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b5734-702c-42cc-81bb-8e75b0a5ac07 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.261542 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b5734-702c-42cc-81bb-8e75b0a5ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.261805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b5734-702c-42cc-81bb-8e75b0a5ac07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.262423 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b5734-702c-42cc-81bb-8e75b0a5ac07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:06.264317 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b5734-702c-42cc-81bb-8e75b0a5ac07 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:06.292499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1398/2833] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:20:06 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:06.296886 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5e80-b6d4-4909-ab77-8fb831e8f656 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:06.307722 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc5e80-b6d4-4909-ab77-8fb831e8f656 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:06.371713 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1649c-d827-42e9-a84d-6f69c45025ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:06.372231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1649c-d827-42e9-a84d-6f69c45025ba admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.372526 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1649c-d827-42e9-a84d-6f69c45025ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.372824 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1649c-d827-42e9-a84d-6f69c45025ba admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.373461 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1649c-d827-42e9-a84d-6f69c45025ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:06.375439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1649c-d827-42e9-a84d-6f69c45025ba admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:06.399701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1436/2834] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:20:06 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:06.406106 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b5734-702c-42cc-81bb-8e75b0a5ac07 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:06.418193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b5734-702c-42cc-81bb-8e75b0a5ac07 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:06.423744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fee83-a52a-4e99-995f-34b5e1ac4d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:06.424365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fee83-a52a-4e99-995f-34b5e1ac4d13 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.424638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fee83-a52a-4e99-995f-34b5e1ac4d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.424904 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fee83-a52a-4e99-995f-34b5e1ac4d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.425571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fee83-a52a-4e99-995f-34b5e1ac4d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:06.427161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0fee83-a52a-4e99-995f-34b5e1ac4d13 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:06.437747 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1399/2835] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:06.442229 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1649c-d827-42e9-a84d-6f69c45025ba admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:06.451753 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:06.456299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1649c-d827-42e9-a84d-6f69c45025ba admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:06.462948 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff83f24-17f3-4bfe-b309-81edea749e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:06.463620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff83f24-17f3-4bfe-b309-81edea749e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.463899 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff83f24-17f3-4bfe-b309-81edea749e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.464170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff83f24-17f3-4bfe-b309-81edea749e94 admin admin] PATH_INFO: `/v3/projects/15962e9d44a244689293521c770c95c5/users/8fcf7cd78a9844c1bf2fef7040fccfdd/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.480421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff83f24-17f3-4bfe-b309-81edea749e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15962e9d44a244689293521c770c95c5, user_id=8fcf7cd78a9844c1bf2fef7040fccfdd, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:06.483177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff83f24-17f3-4bfe-b309-81edea749e94 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:06.498804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1437/2836] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:06 2022] PUT /identity/v3/projects/15962e9d44a244689293521c770c95c5/users/8fcf7cd78a9844c1bf2fef7040fccfdd/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:20:06.502943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fee83-a52a-4e99-995f-34b5e1ac4d13 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:06.513082 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fee83-a52a-4e99-995f-34b5e1ac4d13 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:06.571894 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35680b65-521f-4762-9de4-28ef3b45f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:06.572484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35680b65-521f-4762-9de4-28ef3b45f95d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.572765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35680b65-521f-4762-9de4-28ef3b45f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.573017 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35680b65-521f-4762-9de4-28ef3b45f95d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.573698 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35680b65-521f-4762-9de4-28ef3b45f95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:06.575297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35680b65-521f-4762-9de4-28ef3b45f95d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:06.585323 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1400/2837] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:06.589674 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff83f24-17f3-4bfe-b309-81edea749e94 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:06.600695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff83f24-17f3-4bfe-b309-81edea749e94 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:06.605615 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30acb-af96-450b-aa13-0af7bbb76a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:06.606269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30acb-af96-450b-aa13-0af7bbb76a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.606593 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30acb-af96-450b-aa13-0af7bbb76a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.606875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30acb-af96-450b-aa13-0af7bbb76a90 admin admin] PATH_INFO: `/v3/projects/15962e9d44a244689293521c770c95c5/users/8fcf7cd78a9844c1bf2fef7040fccfdd/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.608871 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f30acb-af96-450b-aa13-0af7bbb76a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15962e9d44a244689293521c770c95c5, user_id=8fcf7cd78a9844c1bf2fef7040fccfdd, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:06.611580 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f30acb-af96-450b-aa13-0af7bbb76a90 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:06.623278 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1438/2838] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:06 2022] PUT /identity/v3/projects/15962e9d44a244689293521c770c95c5/users/8fcf7cd78a9844c1bf2fef7040fccfdd/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:06.633614 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88852da5-a849-44e6-b0c4-11097e345a8d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.633896 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88852da5-a849-44e6-b0c4-11097e345a8d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.634162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88852da5-a849-44e6-b0c4-11097e345a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.663563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-88852da5-a849-44e6-b0c4-11097e345a8d None None] MFA Rules not processed for user `8fcf7cd78a9844c1bf2fef7040fccfdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:06.664780 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-88852da5-a849-44e6-b0c4-11097e345a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:06.735909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1401/2839] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:06.748070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30acb-af96-450b-aa13-0af7bbb76a90 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:06.750184 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-07f30acb-af96-450b-aa13-0af7bbb76a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:06.812755 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30acb-af96-450b-aa13-0af7bbb76a90 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:06.817195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c188c79-5dd8-42f4-a75d-e67807f1a9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:06.817801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c188c79-5dd8-42f4-a75d-e67807f1a9df service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.818086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c188c79-5dd8-42f4-a75d-e67807f1a9df service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.818361 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c188c79-5dd8-42f4-a75d-e67807f1a9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.828217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c188c79-5dd8-42f4-a75d-e67807f1a9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:06.829737 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c188c79-5dd8-42f4-a75d-e67807f1a9df service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:06.839677 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1439/2840] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:06.887654 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88852da5-a849-44e6-b0c4-11097e345a8d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:06.889316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-88852da5-a849-44e6-b0c4-11097e345a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:06.902670 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88852da5-a849-44e6-b0c4-11097e345a8d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:06.906966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cee75-b546-4741-9a21-f590bf8b81a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:06.907569 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cee75-b546-4741-9a21-f590bf8b81a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:06.907848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cee75-b546-4741-9a21-f590bf8b81a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:06.908119 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cee75-b546-4741-9a21-f590bf8b81a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:06.917765 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:06.965953 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cee75-b546-4741-9a21-f590bf8b81a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:06.967387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cee75-b546-4741-9a21-f590bf8b81a0 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:06.976278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1402/2841] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:10.360027 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c188c79-5dd8-42f4-a75d-e67807f1a9df service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:10.424984 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c188c79-5dd8-42f4-a75d-e67807f1a9df service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:10.430359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:10.430989 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:10.431270 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:10.431541 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] PATH_INFO: `/v3/users/bdda79e4a52c427abb6d3d1adfa838f0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:10.432792 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdda79e4a52c427abb6d3d1adfa838f0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:10.434763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:10.491512 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdda79e4a52c427abb6d3d1adfa838f0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:10.492590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdda79e4a52c427abb6d3d1adfa838f0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:10.509785 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdda79e4a52c427abb6d3d1adfa838f0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:10.519228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdda79e4a52c427abb6d3d1adfa838f0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:10.519855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdda79e4a52c427abb6d3d1adfa838f0'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:10.521428 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:10.534823 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1440/2842] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:20:10 2022] DELETE /identity/v3/users/bdda79e4a52c427abb6d3d1adfa838f0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:10.539671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347fdb0-90d3-41cc-811a-167715d19e4f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:10.540146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347fdb0-90d3-41cc-811a-167715d19e4f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:10.540270 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347fdb0-90d3-41cc-811a-167715d19e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:10.565363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9347fdb0-90d3-41cc-811a-167715d19e4f None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:10.566588 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9347fdb0-90d3-41cc-811a-167715d19e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:10.629535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1403/2843] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:10.639516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:10.641219 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:10.702386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289cc2-e835-4f40-9e90-99e788edc335 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:10.706803 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdd8cd-3c3c-4666-b0ed-4c9545f98033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:10.707410 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdd8cd-3c3c-4666-b0ed-4c9545f98033 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:10.707690 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdd8cd-3c3c-4666-b0ed-4c9545f98033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:10.707960 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdd8cd-3c3c-4666-b0ed-4c9545f98033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:10.717862 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdd8cd-3c3c-4666-b0ed-4c9545f98033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:10.719292 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdd8cd-3c3c-4666-b0ed-4c9545f98033 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:10.729260 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1441/2844] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:11.004649 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347fdb0-90d3-41cc-811a-167715d19e4f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:11.006455 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9347fdb0-90d3-41cc-811a-167715d19e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:11.021478 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347fdb0-90d3-41cc-811a-167715d19e4f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:11.027503 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:11.028141 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:11.028417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:11.028771 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] PATH_INFO: `/v3/projects/d0fabedabc394e0da6dad43331d63731` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:11.029917 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0fabedabc394e0da6dad43331d63731)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:11.031842 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:11.080960 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0fabedabc394e0da6dad43331d63731', 'request_id': 'req-9477d628-3ee7-483d-b269-790f7bfffd9c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.086565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0fabedabc394e0da6dad43331d63731', 'request_id': 'req-9477d628-3ee7-483d-b269-790f7bfffd9c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.095562 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0fabedabc394e0da6dad43331d63731', 'request_id': 'req-9477d628-3ee7-483d-b269-790f7bfffd9c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.106513 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] The token cache is being invalidate because project d0fabedabc394e0da6dad43331d63731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:20:11.106801 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.107447 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.108913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1404/2845] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:20:11 2022] DELETE /identity/v3/projects/d0fabedabc394e0da6dad43331d63731 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:11.113273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdd8cd-3c3c-4666-b0ed-4c9545f98033 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:11.123346 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdd8cd-3c3c-4666-b0ed-4c9545f98033 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:11.179627 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:11.180255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:11.180538 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:11.180807 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] PATH_INFO: `/v3/users/8fcf7cd78a9844c1bf2fef7040fccfdd` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:11.181953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fcf7cd78a9844c1bf2fef7040fccfdd)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:11.183866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:11.233699 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fcf7cd78a9844c1bf2fef7040fccfdd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.234384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fcf7cd78a9844c1bf2fef7040fccfdd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.247255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fcf7cd78a9844c1bf2fef7040fccfdd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.255061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fcf7cd78a9844c1bf2fef7040fccfdd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.255707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-90d723e3-040f-465d-af84-1db238ea1aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fcf7cd78a9844c1bf2fef7040fccfdd'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.268192 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1442/2846] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:20:11 2022] DELETE /identity/v3/users/8fcf7cd78a9844c1bf2fef7040fccfdd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:11.544937 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:11.546726 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:11.562637 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477d628-3ee7-483d-b269-790f7bfffd9c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:11.598347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:11.626152 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:11.626815 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:11.627127 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:11.627403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] PATH_INFO: `/v3/projects/15962e9d44a244689293521c770c95c5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:11.628545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=15962e9d44a244689293521c770c95c5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:11.630571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:11.681064 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15962e9d44a244689293521c770c95c5', 'request_id': 'req-4e27b685-2add-4979-862b-84d7115cc90b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.686480 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15962e9d44a244689293521c770c95c5', 'request_id': 'req-4e27b685-2add-4979-862b-84d7115cc90b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.694686 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15962e9d44a244689293521c770c95c5', 'request_id': 'req-4e27b685-2add-4979-862b-84d7115cc90b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.706060 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] The token cache is being invalidate because project 15962e9d44a244689293521c770c95c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:20:11.706351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.707021 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4e27b685-2add-4979-862b-84d7115cc90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:11.708525 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1405/2847] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:20:11 2022] DELETE /identity/v3/projects/15962e9d44a244689293521c770c95c5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:11.713480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb141450-f176-47d0-87c0-1779c20a2fde None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:11.713973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb141450-f176-47d0-87c0-1779c20a2fde None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:11.714076 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb141450-f176-47d0-87c0-1779c20a2fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:11.734645 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-cb141450-f176-47d0-87c0-1779c20a2fde None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:11.735882 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-cb141450-f176-47d0-87c0-1779c20a2fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:11.741726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:11.800439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1443/2848] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:11.808611 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dab191-5cba-45ff-9de8-2dcbdd24a7ea None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:11.808898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dab191-5cba-45ff-9de8-2dcbdd24a7ea None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:11.809213 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dab191-5cba-45ff-9de8-2dcbdd24a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:11.831109 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c0dab191-5cba-45ff-9de8-2dcbdd24a7ea None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:11.832388 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c0dab191-5cba-45ff-9de8-2dcbdd24a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:11.841404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1406/2849] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:11.846222 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb141450-f176-47d0-87c0-1779c20a2fde None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:11.856655 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb141450-f176-47d0-87c0-1779c20a2fde None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:11.862556 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d7c0f-2dfc-4458-801b-2de36c762128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:11.863165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d7c0f-2dfc-4458-801b-2de36c762128 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:11.863446 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d7c0f-2dfc-4458-801b-2de36c762128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:11.863714 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d7c0f-2dfc-4458-801b-2de36c762128 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:11.864369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d7c0f-2dfc-4458-801b-2de36c762128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:20:11.864666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d7c0f-2dfc-4458-801b-2de36c762128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:11.866304 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d7c0f-2dfc-4458-801b-2de36c762128 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:11.878963 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1444/2850] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:20:11.883321 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dab191-5cba-45ff-9de8-2dcbdd24a7ea None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:11.893505 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dab191-5cba-45ff-9de8-2dcbdd24a7ea None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:11.899472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1de620-379c-4772-a6ea-1d77b287c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:11.900081 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1de620-379c-4772-a6ea-1d77b287c6dd admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:11.900354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1de620-379c-4772-a6ea-1d77b287c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:11.900624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1de620-379c-4772-a6ea-1d77b287c6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:11.901273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1de620-379c-4772-a6ea-1d77b287c6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:11.903210 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1de620-379c-4772-a6ea-1d77b287c6dd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:11.932903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1407/2851] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:20:11 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:11.937386 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d7c0f-2dfc-4458-801b-2de36c762128 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:11.947740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d7c0f-2dfc-4458-801b-2de36c762128 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.015563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75c48c-c349-4f6d-a663-06a20cd422cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.016172 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c48c-c349-4f6d-a663-06a20cd422cc admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.016468 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c48c-c349-4f6d-a663-06a20cd422cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.016734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c48c-c349-4f6d-a663-06a20cd422cc admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.017397 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75c48c-c349-4f6d-a663-06a20cd422cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.019347 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75c48c-c349-4f6d-a663-06a20cd422cc admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.045866 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1445/2852] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:20:11 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:12.047161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1de620-379c-4772-a6ea-1d77b287c6dd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:12.057921 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1de620-379c-4772-a6ea-1d77b287c6dd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.063183 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a959b-3a79-44b0-be57-50e980f61636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.063875 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a959b-3a79-44b0-be57-50e980f61636 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.064151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a959b-3a79-44b0-be57-50e980f61636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.064419 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a959b-3a79-44b0-be57-50e980f61636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.065080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a959b-3a79-44b0-be57-50e980f61636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.066668 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a959b-3a79-44b0-be57-50e980f61636 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.077593 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1408/2853] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:12.081775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75c48c-c349-4f6d-a663-06a20cd422cc admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:12.092469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75c48c-c349-4f6d-a663-06a20cd422cc admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.098422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b411041-8d61-43fc-aa0c-5e7e95587a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.099011 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b411041-8d61-43fc-aa0c-5e7e95587a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.099294 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b411041-8d61-43fc-aa0c-5e7e95587a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.099563 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b411041-8d61-43fc-aa0c-5e7e95587a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.100217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b411041-8d61-43fc-aa0c-5e7e95587a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.101875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b411041-8d61-43fc-aa0c-5e7e95587a17 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.113734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1446/2854] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:12.117843 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a959b-3a79-44b0-be57-50e980f61636 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:12.128687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a959b-3a79-44b0-be57-50e980f61636 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.134263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f110431-365a-47b6-9e1e-c1ae884663f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.134913 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f110431-365a-47b6-9e1e-c1ae884663f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.135185 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f110431-365a-47b6-9e1e-c1ae884663f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.135453 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f110431-365a-47b6-9e1e-c1ae884663f0 admin admin] PATH_INFO: `/v3/projects/cb87480190004f9181f8387b47510b70/users/aff75277f28e4a6993888d14936207d1/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.150679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f110431-365a-47b6-9e1e-c1ae884663f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb87480190004f9181f8387b47510b70, user_id=aff75277f28e4a6993888d14936207d1, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.153354 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f110431-365a-47b6-9e1e-c1ae884663f0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.167598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1409/2855] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:12 2022] PUT /identity/v3/projects/cb87480190004f9181f8387b47510b70/users/aff75277f28e4a6993888d14936207d1/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:12.179991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410a87-08a6-4261-a1ea-452ba360a3df None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.180332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410a87-08a6-4261-a1ea-452ba360a3df None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.180730 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19410a87-08a6-4261-a1ea-452ba360a3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.218088 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-19410a87-08a6-4261-a1ea-452ba360a3df None None] MFA Rules not processed for user `aff75277f28e4a6993888d14936207d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:12.219269 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-19410a87-08a6-4261-a1ea-452ba360a3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:12.289264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1447/2856] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:12 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:20:12.293950 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f110431-365a-47b6-9e1e-c1ae884663f0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:12.354786 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f110431-365a-47b6-9e1e-c1ae884663f0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.359681 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe258f-b266-4fa9-9ddf-b95fc50b9ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.360283 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe258f-b266-4fa9-9ddf-b95fc50b9ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.360594 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe258f-b266-4fa9-9ddf-b95fc50b9ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.360863 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe258f-b266-4fa9-9ddf-b95fc50b9ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.361506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe258f-b266-4fa9-9ddf-b95fc50b9ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.363406 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe258f-b266-4fa9-9ddf-b95fc50b9ec8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.368814 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:12.396449 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1410/2857] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:20:12 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:12.400671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19410a87-08a6-4261-a1ea-452ba360a3df None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:12.411660 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19410a87-08a6-4261-a1ea-452ba360a3df None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.415607 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:12.473578 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce5703-4a5b-4ff6-b7c5-6f6c8d6c24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.474130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5703-4a5b-4ff6-b7c5-6f6c8d6c24fe admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.474412 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5703-4a5b-4ff6-b7c5-6f6c8d6c24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.474689 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce5703-4a5b-4ff6-b7c5-6f6c8d6c24fe admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.475328 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce5703-4a5b-4ff6-b7c5-6f6c8d6c24fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.477283 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce5703-4a5b-4ff6-b7c5-6f6c8d6c24fe admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.501470 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1448/2858] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:20:12 2022] POST /identity/v3/users => generated 307 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:20:12.506961 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe258f-b266-4fa9-9ddf-b95fc50b9ec8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:12.517662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe258f-b266-4fa9-9ddf-b95fc50b9ec8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.523623 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46cf5-646f-4551-a99f-90b9e064226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.524209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46cf5-646f-4551-a99f-90b9e064226f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.524482 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46cf5-646f-4551-a99f-90b9e064226f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.524744 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be46cf5-646f-4551-a99f-90b9e064226f admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.525408 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46cf5-646f-4551-a99f-90b9e064226f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.527004 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be46cf5-646f-4551-a99f-90b9e064226f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.537921 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1411/2859] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:12.542095 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce5703-4a5b-4ff6-b7c5-6f6c8d6c24fe admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:12.552908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce5703-4a5b-4ff6-b7c5-6f6c8d6c24fe admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.559273 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790512-19ca-4239-8566-2c5bf96eb32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.559938 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790512-19ca-4239-8566-2c5bf96eb32e admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.560231 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790512-19ca-4239-8566-2c5bf96eb32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.560493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790512-19ca-4239-8566-2c5bf96eb32e admin admin] PATH_INFO: `/v3/projects/d5fe70c1cf904f94a144a121683dfbe5/users/d1a1e9285cf7438283b9d45cbef94fa3/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.578522 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790512-19ca-4239-8566-2c5bf96eb32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fe70c1cf904f94a144a121683dfbe5, user_id=d1a1e9285cf7438283b9d45cbef94fa3, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.583137 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790512-19ca-4239-8566-2c5bf96eb32e admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.600525 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1449/2860] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:12 2022] PUT /identity/v3/projects/d5fe70c1cf904f94a144a121683dfbe5/users/d1a1e9285cf7438283b9d45cbef94fa3/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:12.604597 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46cf5-646f-4551-a99f-90b9e064226f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:12.614870 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be46cf5-646f-4551-a99f-90b9e064226f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.673231 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969fa4a-1726-4f2d-9310-fdc5184d1752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.673851 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969fa4a-1726-4f2d-9310-fdc5184d1752 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.674130 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969fa4a-1726-4f2d-9310-fdc5184d1752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.674382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969fa4a-1726-4f2d-9310-fdc5184d1752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.675029 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969fa4a-1726-4f2d-9310-fdc5184d1752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.676632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969fa4a-1726-4f2d-9310-fdc5184d1752 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.686535 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1412/2861] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:12.690949 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790512-19ca-4239-8566-2c5bf96eb32e admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:12.701530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790512-19ca-4239-8566-2c5bf96eb32e admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.706390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719944d-2535-48a0-ac6c-a74920d590ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.707056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719944d-2535-48a0-ac6c-a74920d590ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.707336 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719944d-2535-48a0-ac6c-a74920d590ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.707610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719944d-2535-48a0-ac6c-a74920d590ec admin admin] PATH_INFO: `/v3/projects/d5fe70c1cf904f94a144a121683dfbe5/users/d1a1e9285cf7438283b9d45cbef94fa3/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.709573 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719944d-2535-48a0-ac6c-a74920d590ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fe70c1cf904f94a144a121683dfbe5, user_id=d1a1e9285cf7438283b9d45cbef94fa3, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.712223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719944d-2535-48a0-ac6c-a74920d590ec admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.723266 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1450/2862] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:12 2022] PUT /identity/v3/projects/d5fe70c1cf904f94a144a121683dfbe5/users/d1a1e9285cf7438283b9d45cbef94fa3/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:12.733496 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef3725-40b3-43a0-8cf1-aa21955384af None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.733782 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef3725-40b3-43a0-8cf1-aa21955384af None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.734068 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef3725-40b3-43a0-8cf1-aa21955384af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.763404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d6ef3725-40b3-43a0-8cf1-aa21955384af None None] MFA Rules not processed for user `d1a1e9285cf7438283b9d45cbef94fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:12.764580 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d6ef3725-40b3-43a0-8cf1-aa21955384af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:12.832687 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1413/2863] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:12 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:12.844495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719944d-2535-48a0-ac6c-a74920d590ec admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:12.846636 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-d719944d-2535-48a0-ac6c-a74920d590ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:12.907900 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719944d-2535-48a0-ac6c-a74920d590ec admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:12.912112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e5b1-ebb5-4a33-874b-f0e337a8bf29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:12.912764 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e5b1-ebb5-4a33-874b-f0e337a8bf29 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:12.913058 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e5b1-ebb5-4a33-874b-f0e337a8bf29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:12.913332 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e5b1-ebb5-4a33-874b-f0e337a8bf29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:12.924376 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e5b1-ebb5-4a33-874b-f0e337a8bf29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:12.925876 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e5b1-ebb5-4a33-874b-f0e337a8bf29 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:12.935921 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1451/2864] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:12 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:13.027266 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef3725-40b3-43a0-8cf1-aa21955384af None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:13.042834 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef3725-40b3-43a0-8cf1-aa21955384af None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:13.049001 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494d8d0-b72e-4ca2-bad8-71abbe1cb8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:13.049629 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494d8d0-b72e-4ca2-bad8-71abbe1cb8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:13.049936 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494d8d0-b72e-4ca2-bad8-71abbe1cb8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:13.050467 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494d8d0-b72e-4ca2-bad8-71abbe1cb8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:13.106039 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:13.108569 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494d8d0-b72e-4ca2-bad8-71abbe1cb8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:13.110703 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494d8d0-b72e-4ca2-bad8-71abbe1cb8e5 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:13.121898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1414/2865] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:13 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:17.267210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e5b1-ebb5-4a33-874b-f0e337a8bf29 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:17.340763 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e5b1-ebb5-4a33-874b-f0e337a8bf29 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:17.346511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:17.347144 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:17.347421 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:17.347665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] PATH_INFO: `/v3/users/aff75277f28e4a6993888d14936207d1` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:17.348849 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff75277f28e4a6993888d14936207d1)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:17.350827 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:17.353375 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:17.400988 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff75277f28e4a6993888d14936207d1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:17.401673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff75277f28e4a6993888d14936207d1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:17.414192 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff75277f28e4a6993888d14936207d1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:17.423226 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff75277f28e4a6993888d14936207d1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:17.423893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff75277f28e4a6993888d14936207d1'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:17.436479 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1452/2866] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:20:17 2022] DELETE /identity/v3/users/aff75277f28e4a6993888d14936207d1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:17.440984 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54621504-26b9-4f0b-93cb-601de1c7572b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:17.441481 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54621504-26b9-4f0b-93cb-601de1c7572b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:17.441587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54621504-26b9-4f0b-93cb-601de1c7572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:17.461677 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-54621504-26b9-4f0b-93cb-601de1c7572b None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:17.462857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-54621504-26b9-4f0b-93cb-601de1c7572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:17.533551 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1415/2867] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:17.543843 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:17.545591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:17.608039 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6885d1-d7b6-428d-a829-9859ff2ec159 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:17.612516 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61508194-7c36-4b91-8fd6-728506903643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:17.613159 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508194-7c36-4b91-8fd6-728506903643 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:17.613439 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508194-7c36-4b91-8fd6-728506903643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:17.613706 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61508194-7c36-4b91-8fd6-728506903643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:17.623894 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61508194-7c36-4b91-8fd6-728506903643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:17.625354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61508194-7c36-4b91-8fd6-728506903643 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:17.634982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1453/2868] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:17.915050 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54621504-26b9-4f0b-93cb-601de1c7572b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:17.916754 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-54621504-26b9-4f0b-93cb-601de1c7572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:17.933563 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54621504-26b9-4f0b-93cb-601de1c7572b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:17.938285 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:17.938921 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:17.939220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:17.939632 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] PATH_INFO: `/v3/projects/cb87480190004f9181f8387b47510b70` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:17.940959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb87480190004f9181f8387b47510b70)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:17.942897 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:17.990012 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb87480190004f9181f8387b47510b70', 'request_id': 'req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:17.996072 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb87480190004f9181f8387b47510b70', 'request_id': 'req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.004873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb87480190004f9181f8387b47510b70', 'request_id': 'req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.016219 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] The token cache is being invalidate because project cb87480190004f9181f8387b47510b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:20:18.016506 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.017159 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.018685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1416/2869] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:20:17 2022] DELETE /identity/v3/projects/cb87480190004f9181f8387b47510b70 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:18.022855 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61508194-7c36-4b91-8fd6-728506903643 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:18.032812 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61508194-7c36-4b91-8fd6-728506903643 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:18.091735 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:18.092359 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:18.092638 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:18.092906 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] PATH_INFO: `/v3/users/d1a1e9285cf7438283b9d45cbef94fa3` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:18.094171 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a1e9285cf7438283b9d45cbef94fa3)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:18.096130 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:18.125711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:18.149738 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a1e9285cf7438283b9d45cbef94fa3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.150395 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a1e9285cf7438283b9d45cbef94fa3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.162798 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a1e9285cf7438283b9d45cbef94fa3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.170775 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a1e9285cf7438283b9d45cbef94fa3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.171431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-d2e9f3b7-f2b5-4e80-b51c-7f0019e855fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a1e9285cf7438283b9d45cbef94fa3'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.183496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1454/2870] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:20:18 2022] DELETE /identity/v3/users/d1a1e9285cf7438283b9d45cbef94fa3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:18.458583 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:18.460465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:18.475763 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661df2ea-2fbb-47b2-8e93-d10d9f6e8c76 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:18.535054 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:18.535692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:18.535969 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:18.536239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] PATH_INFO: `/v3/projects/d5fe70c1cf904f94a144a121683dfbe5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:18.537417 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5fe70c1cf904f94a144a121683dfbe5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:18.539351 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:18.562612 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:18.588664 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5fe70c1cf904f94a144a121683dfbe5', 'request_id': 'req-a7312325-79c0-4989-9844-d6c64223c33e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.594895 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5fe70c1cf904f94a144a121683dfbe5', 'request_id': 'req-a7312325-79c0-4989-9844-d6c64223c33e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.603628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5fe70c1cf904f94a144a121683dfbe5', 'request_id': 'req-a7312325-79c0-4989-9844-d6c64223c33e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.614743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] The token cache is being invalidate because project d5fe70c1cf904f94a144a121683dfbe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:20:18.615024 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.615648 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7312325-79c0-4989-9844-d6c64223c33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:18.617148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1417/2871] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:20:18 2022] DELETE /identity/v3/projects/d5fe70c1cf904f94a144a121683dfbe5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:18.622673 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa5e8-d27f-47cf-b173-9f7a9f253125 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:18.623167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa5e8-d27f-47cf-b173-9f7a9f253125 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:18.623277 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fa5e8-d27f-47cf-b173-9f7a9f253125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:18.645424 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f93fa5e8-d27f-47cf-b173-9f7a9f253125 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:18.646647 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f93fa5e8-d27f-47cf-b173-9f7a9f253125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:18.709310 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1455/2872] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:18.717237 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639cc01-d285-46f6-972e-fdc5fb751db6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:18.717526 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639cc01-d285-46f6-972e-fdc5fb751db6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:18.717806 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639cc01-d285-46f6-972e-fdc5fb751db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:18.738347 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7639cc01-d285-46f6-972e-fdc5fb751db6 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:18.739572 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7639cc01-d285-46f6-972e-fdc5fb751db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:18.748635 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1418/2873] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:18.753086 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fa5e8-d27f-47cf-b173-9f7a9f253125 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:18.763584 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fa5e8-d27f-47cf-b173-9f7a9f253125 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:18.769606 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72460705-c5c6-4403-b1bb-068df34d77a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:18.770207 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72460705-c5c6-4403-b1bb-068df34d77a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:18.770484 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72460705-c5c6-4403-b1bb-068df34d77a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:18.770758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72460705-c5c6-4403-b1bb-068df34d77a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:18.771408 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72460705-c5c6-4403-b1bb-068df34d77a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:20:18.771711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72460705-c5c6-4403-b1bb-068df34d77a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:18.773350 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72460705-c5c6-4403-b1bb-068df34d77a5 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:18.786596 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1456/2874] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:20:18.791679 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639cc01-d285-46f6-972e-fdc5fb751db6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:18.804295 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639cc01-d285-46f6-972e-fdc5fb751db6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:18.810274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3c2ea-af14-415f-89da-fdf0fb63894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:18.810873 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3c2ea-af14-415f-89da-fdf0fb63894d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:18.811151 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3c2ea-af14-415f-89da-fdf0fb63894d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:18.811424 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3c2ea-af14-415f-89da-fdf0fb63894d admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:18.812059 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3c2ea-af14-415f-89da-fdf0fb63894d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:18.814023 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3c2ea-af14-415f-89da-fdf0fb63894d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:18.843363 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1419/2875] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:20:18 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:18.847696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72460705-c5c6-4403-b1bb-068df34d77a5 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:18.858062 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72460705-c5c6-4403-b1bb-068df34d77a5 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:18.917772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d221a1-c775-4d6e-bfcb-a8a80c7710ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:18.918384 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d221a1-c775-4d6e-bfcb-a8a80c7710ea admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:18.918664 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d221a1-c775-4d6e-bfcb-a8a80c7710ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:18.918935 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d221a1-c775-4d6e-bfcb-a8a80c7710ea admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:18.919557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d221a1-c775-4d6e-bfcb-a8a80c7710ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:18.921521 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d221a1-c775-4d6e-bfcb-a8a80c7710ea admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:18.944629 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1457/2876] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:20:18 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:20:18.948877 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3c2ea-af14-415f-89da-fdf0fb63894d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:18.959833 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3c2ea-af14-415f-89da-fdf0fb63894d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:18.965476 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76508a-1ca0-42f0-a336-d8fb57600091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:18.966095 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76508a-1ca0-42f0-a336-d8fb57600091 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:18.966365 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76508a-1ca0-42f0-a336-d8fb57600091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:18.966628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76508a-1ca0-42f0-a336-d8fb57600091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:18.967274 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76508a-1ca0-42f0-a336-d8fb57600091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:18.968856 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76508a-1ca0-42f0-a336-d8fb57600091 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:18.979209 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1420/2877] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:18.983296 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d221a1-c775-4d6e-bfcb-a8a80c7710ea admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:18.994127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d221a1-c775-4d6e-bfcb-a8a80c7710ea admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:19.000049 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010dc04-79a6-4fe6-9354-4918abb8a42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:19.000622 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010dc04-79a6-4fe6-9354-4918abb8a42a admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.000909 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010dc04-79a6-4fe6-9354-4918abb8a42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.001237 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010dc04-79a6-4fe6-9354-4918abb8a42a admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.001907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010dc04-79a6-4fe6-9354-4918abb8a42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:19.003696 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010dc04-79a6-4fe6-9354-4918abb8a42a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:19.016364 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1458/2878] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:19.020708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76508a-1ca0-42f0-a336-d8fb57600091 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:19.031416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76508a-1ca0-42f0-a336-d8fb57600091 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:19.037468 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145cb71-cd6e-463c-b2c9-38f4bfd0364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:19.038124 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145cb71-cd6e-463c-b2c9-38f4bfd0364b admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.038403 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145cb71-cd6e-463c-b2c9-38f4bfd0364b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.038674 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145cb71-cd6e-463c-b2c9-38f4bfd0364b admin admin] PATH_INFO: `/v3/projects/e761a929db7f4e3da48ad59a8425a34f/users/16b06242b7d2423fb9d68ba29d34ba16/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.054571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145cb71-cd6e-463c-b2c9-38f4bfd0364b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e761a929db7f4e3da48ad59a8425a34f, user_id=16b06242b7d2423fb9d68ba29d34ba16, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:19.057269 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145cb71-cd6e-463c-b2c9-38f4bfd0364b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:19.075080 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1421/2879] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:19 2022] PUT /identity/v3/projects/e761a929db7f4e3da48ad59a8425a34f/users/16b06242b7d2423fb9d68ba29d34ba16/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:19.086591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b68e-1d66-4b60-a163-8668e2c213df None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.086879 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b68e-1d66-4b60-a163-8668e2c213df None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.087158 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b68e-1d66-4b60-a163-8668e2c213df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.108329 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:19.118189 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-f034b68e-1d66-4b60-a163-8668e2c213df None None] MFA Rules not processed for user `16b06242b7d2423fb9d68ba29d34ba16`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:19.119913 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f034b68e-1d66-4b60-a163-8668e2c213df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:19.188463 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1459/2880] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:19.193272 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145cb71-cd6e-463c-b2c9-38f4bfd0364b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:19.263866 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145cb71-cd6e-463c-b2c9-38f4bfd0364b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:19.269830 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0048e2-4f26-44fc-80d1-c7884ff6e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:19.270445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0048e2-4f26-44fc-80d1-c7884ff6e33f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.270717 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0048e2-4f26-44fc-80d1-c7884ff6e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.270994 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0048e2-4f26-44fc-80d1-c7884ff6e33f admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.271636 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0048e2-4f26-44fc-80d1-c7884ff6e33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:19.273610 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0048e2-4f26-44fc-80d1-c7884ff6e33f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:19.304336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1422/2881] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:20:19 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:19.308789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b68e-1d66-4b60-a163-8668e2c213df None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:19.320080 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b68e-1d66-4b60-a163-8668e2c213df None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:19.384919 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbc2c-069c-4424-8a7a-61826f7c6907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:19.385562 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbc2c-069c-4424-8a7a-61826f7c6907 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.385842 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbc2c-069c-4424-8a7a-61826f7c6907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.386112 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbc2c-069c-4424-8a7a-61826f7c6907 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.386772 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcbc2c-069c-4424-8a7a-61826f7c6907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:19.388707 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcbc2c-069c-4424-8a7a-61826f7c6907 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:19.411472 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1460/2882] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:20:19 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:20:19.415676 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0048e2-4f26-44fc-80d1-c7884ff6e33f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:19.426063 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0048e2-4f26-44fc-80d1-c7884ff6e33f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:19.431692 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4649274-e22d-421e-bf20-b77aba7f0b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:19.432341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649274-e22d-421e-bf20-b77aba7f0b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.432622 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649274-e22d-421e-bf20-b77aba7f0b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.432879 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4649274-e22d-421e-bf20-b77aba7f0b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.433571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4649274-e22d-421e-bf20-b77aba7f0b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:19.435217 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4649274-e22d-421e-bf20-b77aba7f0b71 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:19.446373 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1423/2883] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:19.450481 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbc2c-069c-4424-8a7a-61826f7c6907 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:19.461065 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbc2c-069c-4424-8a7a-61826f7c6907 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:19.466946 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c68fc-29af-4141-9d76-c0ca6bb02957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:19.467604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c68fc-29af-4141-9d76-c0ca6bb02957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.467907 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c68fc-29af-4141-9d76-c0ca6bb02957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.468166 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c68fc-29af-4141-9d76-c0ca6bb02957 admin admin] PATH_INFO: `/v3/projects/a636c5525f3544058f6925954ba68288/users/ad5bc3797c7c467f8543f0503313072e/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.484044 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c68fc-29af-4141-9d76-c0ca6bb02957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a636c5525f3544058f6925954ba68288, user_id=ad5bc3797c7c467f8543f0503313072e, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:19.486822 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c68fc-29af-4141-9d76-c0ca6bb02957 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:19.501169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1461/2884] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:19 2022] PUT /identity/v3/projects/a636c5525f3544058f6925954ba68288/users/ad5bc3797c7c467f8543f0503313072e/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:20:19.505313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4649274-e22d-421e-bf20-b77aba7f0b71 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:19.516874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4649274-e22d-421e-bf20-b77aba7f0b71 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:19.534016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:19.576345 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71893661-4f1a-415d-9a4a-7147cb9e0153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:19.576966 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71893661-4f1a-415d-9a4a-7147cb9e0153 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.577273 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71893661-4f1a-415d-9a4a-7147cb9e0153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.577545 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71893661-4f1a-415d-9a4a-7147cb9e0153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.578196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71893661-4f1a-415d-9a4a-7147cb9e0153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:19.579829 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71893661-4f1a-415d-9a4a-7147cb9e0153 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:19.591053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1424/2885] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:19.603747 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c68fc-29af-4141-9d76-c0ca6bb02957 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:19.616021 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c68fc-29af-4141-9d76-c0ca6bb02957 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:19.623495 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6626202-d21a-4a3b-92f4-654fef8cc597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:19.624195 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6626202-d21a-4a3b-92f4-654fef8cc597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.624469 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6626202-d21a-4a3b-92f4-654fef8cc597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.624761 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6626202-d21a-4a3b-92f4-654fef8cc597 admin admin] PATH_INFO: `/v3/projects/a636c5525f3544058f6925954ba68288/users/ad5bc3797c7c467f8543f0503313072e/roles/77285ef607e34662b6234656fe8043d0` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.627116 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6626202-d21a-4a3b-92f4-654fef8cc597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a636c5525f3544058f6925954ba68288, user_id=ad5bc3797c7c467f8543f0503313072e, role_id=77285ef607e34662b6234656fe8043d0)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:19.629830 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6626202-d21a-4a3b-92f4-654fef8cc597 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:19.642340 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1462/2886] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:19 2022] PUT /identity/v3/projects/a636c5525f3544058f6925954ba68288/users/ad5bc3797c7c467f8543f0503313072e/roles/77285ef607e34662b6234656fe8043d0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:19.653279 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e4081-48c8-450f-ab48-c77e7b89243e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.653656 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e4081-48c8-450f-ab48-c77e7b89243e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.654005 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e4081-48c8-450f-ab48-c77e7b89243e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.689445 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c43e4081-48c8-450f-ab48-c77e7b89243e None None] MFA Rules not processed for user `ad5bc3797c7c467f8543f0503313072e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:19.691222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c43e4081-48c8-450f-ab48-c77e7b89243e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:19.773150 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1425/2887] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:19.783908 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6626202-d21a-4a3b-92f4-654fef8cc597 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:19.785902 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6626202-d21a-4a3b-92f4-654fef8cc597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:19.851142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6626202-d21a-4a3b-92f4-654fef8cc597 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:19.855431 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef5339-2189-48ae-a1f3-ca009e0eddd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:19.856036 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5339-2189-48ae-a1f3-ca009e0eddd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:19.856318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5339-2189-48ae-a1f3-ca009e0eddd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:19.856591 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5339-2189-48ae-a1f3-ca009e0eddd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:19.860872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:19.921893 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef5339-2189-48ae-a1f3-ca009e0eddd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:19.923357 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef5339-2189-48ae-a1f3-ca009e0eddd8 service cinder] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:19.933961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1463/2888] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:24.255218 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e4081-48c8-450f-ab48-c77e7b89243e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:24.256963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c43e4081-48c8-450f-ab48-c77e7b89243e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:24.270406 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e4081-48c8-450f-ab48-c77e7b89243e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:24.274287 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed801a-0259-4619-add8-3630da0bd144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:24.274889 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed801a-0259-4619-add8-3630da0bd144 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:24.275168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed801a-0259-4619-add8-3630da0bd144 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:24.275558 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed801a-0259-4619-add8-3630da0bd144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:24.284722 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed801a-0259-4619-add8-3630da0bd144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:24.286200 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed801a-0259-4619-add8-3630da0bd144 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:24.295529 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1426/2889] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:29.257904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef5339-2189-48ae-a1f3-ca009e0eddd8 service cinder] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:29.323864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef5339-2189-48ae-a1f3-ca009e0eddd8 service cinder] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:29.328904 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:29.329552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:29.329831 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:29.330115 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] PATH_INFO: `/v3/users/16b06242b7d2423fb9d68ba29d34ba16` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:29.331285 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b06242b7d2423fb9d68ba29d34ba16)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:29.333261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:29.383708 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b06242b7d2423fb9d68ba29d34ba16'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:29.384383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b06242b7d2423fb9d68ba29d34ba16'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:29.396169 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b06242b7d2423fb9d68ba29d34ba16'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:29.405639 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b06242b7d2423fb9d68ba29d34ba16'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:29.406299 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b06242b7d2423fb9d68ba29d34ba16'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:29.419405 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1464/2890] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:20:29 2022] DELETE /identity/v3/users/16b06242b7d2423fb9d68ba29d34ba16 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:29.424026 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc4c5-428f-4191-ad77-00d10fbe70eb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:29.424541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc4c5-428f-4191-ad77-00d10fbe70eb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:29.424541 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcc4c5-428f-4191-ad77-00d10fbe70eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:29.444358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-39dcc4c5-428f-4191-ad77-00d10fbe70eb None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:29.445598 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-39dcc4c5-428f-4191-ad77-00d10fbe70eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:29.506708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1427/2891] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:29.517133 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:29.518666 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:29.548697 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:29.582782 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b512ba-61d8-44e8-9d51-30cd60470d0a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:29.586496 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f52a9-8318-47da-a644-c7c4e5e0a022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:29.587109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f52a9-8318-47da-a644-c7c4e5e0a022 service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:29.587390 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f52a9-8318-47da-a644-c7c4e5e0a022 service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:29.587670 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f52a9-8318-47da-a644-c7c4e5e0a022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:29.596961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f52a9-8318-47da-a644-c7c4e5e0a022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:29.598436 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f52a9-8318-47da-a644-c7c4e5e0a022 service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:29.608081 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1465/2892] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:29.890663 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc4c5-428f-4191-ad77-00d10fbe70eb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:29.892320 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-39dcc4c5-428f-4191-ad77-00d10fbe70eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:29.907314 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcc4c5-428f-4191-ad77-00d10fbe70eb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:29.914168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:29.914822 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:29.915100 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:29.915374 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] PATH_INFO: `/v3/projects/e761a929db7f4e3da48ad59a8425a34f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:29.917264 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e761a929db7f4e3da48ad59a8425a34f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:29.919316 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:29.946469 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:29.972038 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e761a929db7f4e3da48ad59a8425a34f', 'request_id': 'req-529523d1-05ee-4604-af1e-ef5cc02fa191'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:29.978396 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e761a929db7f4e3da48ad59a8425a34f', 'request_id': 'req-529523d1-05ee-4604-af1e-ef5cc02fa191'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:29.986983 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e761a929db7f4e3da48ad59a8425a34f', 'request_id': 'req-529523d1-05ee-4604-af1e-ef5cc02fa191'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:29.998258 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] The token cache is being invalidate because project e761a929db7f4e3da48ad59a8425a34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:20:29.998547 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:29.999161 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.000638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1428/2893] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:20:29 2022] DELETE /identity/v3/projects/e761a929db7f4e3da48ad59a8425a34f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:30.004795 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f52a9-8318-47da-a644-c7c4e5e0a022 service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:30.014417 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f52a9-8318-47da-a644-c7c4e5e0a022 service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:30.078811 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:30.079642 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:30.079982 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:30.080365 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] PATH_INFO: `/v3/users/ad5bc3797c7c467f8543f0503313072e` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:30.081841 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5bc3797c7c467f8543f0503313072e)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:30.084930 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:30.138217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5bc3797c7c467f8543f0503313072e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.139075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5bc3797c7c467f8543f0503313072e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.154325 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5bc3797c7c467f8543f0503313072e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.164537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5bc3797c7c467f8543f0503313072e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.165225 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-b00e5973-5708-4cca-bda7-45239eb0a570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5bc3797c7c467f8543f0503313072e'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.178979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1466/2894] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:20:30 2022] DELETE /identity/v3/users/ad5bc3797c7c467f8543f0503313072e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:30.454133 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:30.455628 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:30.468865 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529523d1-05ee-4604-af1e-ef5cc02fa191 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:30.526336 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:30.526963 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:30.527234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:30.527561 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] PATH_INFO: `/v3/projects/a636c5525f3544058f6925954ba68288` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:30.528638 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a636c5525f3544058f6925954ba68288)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:30.530587 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:30.585179 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a636c5525f3544058f6925954ba68288', 'request_id': 'req-8828d6fb-25ce-457a-8bbb-d12788bfe358'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.591220 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a636c5525f3544058f6925954ba68288', 'request_id': 'req-8828d6fb-25ce-457a-8bbb-d12788bfe358'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.599278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a636c5525f3544058f6925954ba68288', 'request_id': 'req-8828d6fb-25ce-457a-8bbb-d12788bfe358'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.610022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] The token cache is being invalidate because project a636c5525f3544058f6925954ba68288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:20:30.610306 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.610959 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8828d6fb-25ce-457a-8bbb-d12788bfe358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:30.612463 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1429/2895] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:20:30 2022] DELETE /identity/v3/projects/a636c5525f3544058f6925954ba68288 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:30.618601 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbeb376-9d21-498b-bbe4-3362e9b525ab None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:30.619090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbeb376-9d21-498b-bbe4-3362e9b525ab None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:30.619233 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbeb376-9d21-498b-bbe4-3362e9b525ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:30.640487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-8cbeb376-9d21-498b-bbe4-3362e9b525ab None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:30.641723 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-8cbeb376-9d21-498b-bbe4-3362e9b525ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:30.683956 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:30.703378 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1467/2896] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:30.769376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeff76a-44d7-45dc-894b-3119c43d7b12 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:30.769781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeff76a-44d7-45dc-894b-3119c43d7b12 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:30.770249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeff76a-44d7-45dc-894b-3119c43d7b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:30.793377 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-deeff76a-44d7-45dc-894b-3119c43d7b12 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:30.794267 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-deeff76a-44d7-45dc-894b-3119c43d7b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:30.802122 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1430/2897] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:30.806369 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbeb376-9d21-498b-bbe4-3362e9b525ab None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:30.816435 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbeb376-9d21-498b-bbe4-3362e9b525ab None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:30.821604 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb81ae4-9e28-4b6d-bb11-8a6445aa67ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:30.822211 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb81ae4-9e28-4b6d-bb11-8a6445aa67ae admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:30.822500 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb81ae4-9e28-4b6d-bb11-8a6445aa67ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:30.822762 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb81ae4-9e28-4b6d-bb11-8a6445aa67ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:30.823416 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb81ae4-9e28-4b6d-bb11-8a6445aa67ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:20:30.823716 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb81ae4-9e28-4b6d-bb11-8a6445aa67ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:30.825487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb81ae4-9e28-4b6d-bb11-8a6445aa67ae admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:30.837620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1468/2898] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:20:30.842713 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeff76a-44d7-45dc-894b-3119c43d7b12 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:30.854201 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeff76a-44d7-45dc-894b-3119c43d7b12 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:30.859510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11d77c-635e-431e-afb9-f75da3c8bfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:30.860107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11d77c-635e-431e-afb9-f75da3c8bfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:30.860382 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11d77c-635e-431e-afb9-f75da3c8bfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:30.860652 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11d77c-635e-431e-afb9-f75da3c8bfb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:30.861330 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11d77c-635e-431e-afb9-f75da3c8bfb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:30.863239 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11d77c-635e-431e-afb9-f75da3c8bfb5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:30.894548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1431/2899] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:20:30 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:30.898936 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb81ae4-9e28-4b6d-bb11-8a6445aa67ae admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:30.909398 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb81ae4-9e28-4b6d-bb11-8a6445aa67ae admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:30.966740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca9cdc-99b8-4e96-ba05-1d9326bdee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:30.967349 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9cdc-99b8-4e96-ba05-1d9326bdee31 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:30.967634 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9cdc-99b8-4e96-ba05-1d9326bdee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:30.967932 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca9cdc-99b8-4e96-ba05-1d9326bdee31 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:30.968569 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca9cdc-99b8-4e96-ba05-1d9326bdee31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:30.970537 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca9cdc-99b8-4e96-ba05-1d9326bdee31 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:30.992200 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1469/2900] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:20:30 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:30.996742 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11d77c-635e-431e-afb9-f75da3c8bfb5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:31.007247 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11d77c-635e-431e-afb9-f75da3c8bfb5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:31.013107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc6702-b1c8-4a04-82cf-dbc9560cfa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:31.013743 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc6702-b1c8-4a04-82cf-dbc9560cfa2a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:31.014027 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc6702-b1c8-4a04-82cf-dbc9560cfa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:31.014285 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc6702-b1c8-4a04-82cf-dbc9560cfa2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:31.014930 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc6702-b1c8-4a04-82cf-dbc9560cfa2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:31.016548 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc6702-b1c8-4a04-82cf-dbc9560cfa2a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:31.027193 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1432/2901] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:31.031142 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca9cdc-99b8-4e96-ba05-1d9326bdee31 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:31.041733 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca9cdc-99b8-4e96-ba05-1d9326bdee31 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:31.047872 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648ac5a-39cd-455a-914b-409f093b3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:31.048422 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648ac5a-39cd-455a-914b-409f093b3d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:31.048701 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648ac5a-39cd-455a-914b-409f093b3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:31.048971 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648ac5a-39cd-455a-914b-409f093b3d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:31.049659 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648ac5a-39cd-455a-914b-409f093b3d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:31.051256 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2648ac5a-39cd-455a-914b-409f093b3d8c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:31.062261 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1470/2902] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:20:31.066278 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc6702-b1c8-4a04-82cf-dbc9560cfa2a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:31.071987 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:31.077940 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc6702-b1c8-4a04-82cf-dbc9560cfa2a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:31.084393 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc9978-0af8-46b5-aece-502987d39746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:31.085168 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc9978-0af8-46b5-aece-502987d39746 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:31.085624 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc9978-0af8-46b5-aece-502987d39746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:31.086271 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc9978-0af8-46b5-aece-502987d39746 admin admin] PATH_INFO: `/v3/projects/fd5bc6b171634dbaa005bc4acc19e52b/users/1f9cccdf3d7f4d13afdaac8e1e2d6afc/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:31.108390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc9978-0af8-46b5-aece-502987d39746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5bc6b171634dbaa005bc4acc19e52b, user_id=1f9cccdf3d7f4d13afdaac8e1e2d6afc, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:31.111085 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc9978-0af8-46b5-aece-502987d39746 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:31.126848 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1433/2903] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:31 2022] PUT /identity/v3/projects/fd5bc6b171634dbaa005bc4acc19e52b/users/1f9cccdf3d7f4d13afdaac8e1e2d6afc/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:31.138022 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6955aa-1a06-485b-9a28-84f49f10706b None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:31.138305 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6955aa-1a06-485b-9a28-84f49f10706b None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:31.138579 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6955aa-1a06-485b-9a28-84f49f10706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:31.169695 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-bc6955aa-1a06-485b-9a28-84f49f10706b None None] MFA Rules not processed for user `1f9cccdf3d7f4d13afdaac8e1e2d6afc`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:31.170924 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-bc6955aa-1a06-485b-9a28-84f49f10706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:31.253170 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1471/2904] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:31.268107 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc9978-0af8-46b5-aece-502987d39746 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:31.270061 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-83fc9978-0af8-46b5-aece-502987d39746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:31.334037 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc9978-0af8-46b5-aece-502987d39746 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:31.342301 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110fac-75e3-45f8-9bc1-7e65fbbe69a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c746178628e4df5961982268e642ff7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:31.342927 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110fac-75e3-45f8-9bc1-7e65fbbe69a2 service glance] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:31.343195 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110fac-75e3-45f8-9bc1-7e65fbbe69a2 service glance] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:31.343460 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110fac-75e3-45f8-9bc1-7e65fbbe69a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:31.352441 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7110fac-75e3-45f8-9bc1-7e65fbbe69a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:31.353914 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7110fac-75e3-45f8-9bc1-7e65fbbe69a2 service glance] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:31.362837 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1434/2905] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:41.249734 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:41.358708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:47.017801 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6955aa-1a06-485b-9a28-84f49f10706b None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:47.083744 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6955aa-1a06-485b-9a28-84f49f10706b None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:47.089198 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:47.089828 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:47.090104 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:47.090373 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] PATH_INFO: `/v3/users/1f9cccdf3d7f4d13afdaac8e1e2d6afc` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:47.091550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9cccdf3d7f4d13afdaac8e1e2d6afc)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:47.093514 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:47.143764 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9cccdf3d7f4d13afdaac8e1e2d6afc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:47.144582 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9cccdf3d7f4d13afdaac8e1e2d6afc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:47.157864 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9cccdf3d7f4d13afdaac8e1e2d6afc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:47.167779 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9cccdf3d7f4d13afdaac8e1e2d6afc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:47.168473 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9cccdf3d7f4d13afdaac8e1e2d6afc'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:47.180789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1472/2906] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:20:47 2022] DELETE /identity/v3/users/1f9cccdf3d7f4d13afdaac8e1e2d6afc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:47.185439 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7cedc-1198-4ebf-8d15-7d9d28ed77ab None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:47.185943 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7cedc-1198-4ebf-8d15-7d9d28ed77ab None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:47.186058 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7cedc-1198-4ebf-8d15-7d9d28ed77ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:47.206009 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d6b7cedc-1198-4ebf-8d15-7d9d28ed77ab None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:47.207234 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d6b7cedc-1198-4ebf-8d15-7d9d28ed77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:47.267376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1435/2907] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:47.279035 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:47.281194 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:47.353056 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd16bb-468b-4389-9238-593a10ff519f admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:47.357251 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793a75d-b9d1-456e-a453-2035057b146a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:47.357857 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a75d-b9d1-456e-a453-2035057b146a service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:47.358134 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a75d-b9d1-456e-a453-2035057b146a service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:47.358415 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793a75d-b9d1-456e-a453-2035057b146a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:47.368061 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793a75d-b9d1-456e-a453-2035057b146a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:47.369550 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793a75d-b9d1-456e-a453-2035057b146a service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:47.379480 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1473/2908] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:47.660662 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7cedc-1198-4ebf-8d15-7d9d28ed77ab None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:47.662221 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d6b7cedc-1198-4ebf-8d15-7d9d28ed77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:47.674573 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7cedc-1198-4ebf-8d15-7d9d28ed77ab None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:47.679578 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:47.680222 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:47.680497 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:47.680767 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] PATH_INFO: `/v3/projects/fd5bc6b171634dbaa005bc4acc19e52b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:47.681931 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5bc6b171634dbaa005bc4acc19e52b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:47.683915 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:47.730690 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5bc6b171634dbaa005bc4acc19e52b', 'request_id': 'req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:47.736376 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5bc6b171634dbaa005bc4acc19e52b', 'request_id': 'req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:47.744699 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5bc6b171634dbaa005bc4acc19e52b', 'request_id': 'req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:47.756757 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] The token cache is being invalidate because project fd5bc6b171634dbaa005bc4acc19e52b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:20:47.757070 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:47.757802 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01c1eabb-63c5-4ea8-b3dc-798a10660cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:47.759409 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1436/2909] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:20:47 2022] DELETE /identity/v3/projects/fd5bc6b171634dbaa005bc4acc19e52b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:47.764557 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ef320-f1cd-40bc-8da9-e1697b484ff3 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:47.764852 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ef320-f1cd-40bc-8da9-e1697b484ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:47.765177 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ef320-f1cd-40bc-8da9-e1697b484ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:47.785816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-dd0ef320-f1cd-40bc-8da9-e1697b484ff3 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:47.786969 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-dd0ef320-f1cd-40bc-8da9-e1697b484ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:47.804540 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:47.850105 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1474/2910] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:47.858236 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33296e-b501-4424-9d48-c59f4ea41c8a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:47.858523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33296e-b501-4424-9d48-c59f4ea41c8a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:47.858795 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33296e-b501-4424-9d48-c59f4ea41c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:47.879370 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0f33296e-b501-4424-9d48-c59f4ea41c8a None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:47.880571 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0f33296e-b501-4424-9d48-c59f4ea41c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:47.888955 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1437/2911] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:47.893486 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ef320-f1cd-40bc-8da9-e1697b484ff3 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:47.903492 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ef320-f1cd-40bc-8da9-e1697b484ff3 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:47.909068 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331a512-3bf3-447c-8756-1093726c465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:47.909681 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331a512-3bf3-447c-8756-1093726c465c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:47.909955 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331a512-3bf3-447c-8756-1093726c465c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:47.910223 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331a512-3bf3-447c-8756-1093726c465c admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:47.910917 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331a512-3bf3-447c-8756-1093726c465c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:20:47.911181 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331a512-3bf3-447c-8756-1093726c465c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:47.912804 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331a512-3bf3-447c-8756-1093726c465c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:47.924493 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1475/2912] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:20:47.928903 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33296e-b501-4424-9d48-c59f4ea41c8a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:47.938510 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33296e-b501-4424-9d48-c59f4ea41c8a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:47.944574 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b15ef-dedb-4f66-a449-1cfd43cc455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:47.945248 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b15ef-dedb-4f66-a449-1cfd43cc455a admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:47.945515 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b15ef-dedb-4f66-a449-1cfd43cc455a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:47.945781 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b15ef-dedb-4f66-a449-1cfd43cc455a admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:47.946404 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b15ef-dedb-4f66-a449-1cfd43cc455a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:47.948297 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b15ef-dedb-4f66-a449-1cfd43cc455a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:47.983642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1438/2913] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:20:47 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:47.988456 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331a512-3bf3-447c-8756-1093726c465c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:47.999239 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331a512-3bf3-447c-8756-1093726c465c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:48.061059 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e68f48-6c52-46b3-934d-a083aed6850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:48.061742 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68f48-6c52-46b3-934d-a083aed6850a admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:48.061884 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68f48-6c52-46b3-934d-a083aed6850a admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:48.062087 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68f48-6c52-46b3-934d-a083aed6850a admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:48.062711 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e68f48-6c52-46b3-934d-a083aed6850a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:48.064668 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e68f48-6c52-46b3-934d-a083aed6850a admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:48.089255 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1476/2914] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:20:47 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:48.093659 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b15ef-dedb-4f66-a449-1cfd43cc455a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:48.104549 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b15ef-dedb-4f66-a449-1cfd43cc455a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:48.109465 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e209bd4-fbc8-45ba-8004-c27e9f8907c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:48.110055 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e209bd4-fbc8-45ba-8004-c27e9f8907c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:48.110341 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e209bd4-fbc8-45ba-8004-c27e9f8907c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:48.110606 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e209bd4-fbc8-45ba-8004-c27e9f8907c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:48.111249 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e209bd4-fbc8-45ba-8004-c27e9f8907c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:48.112857 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e209bd4-fbc8-45ba-8004-c27e9f8907c5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:48.123225 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1439/2915] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:48.127156 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e68f48-6c52-46b3-934d-a083aed6850a admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:48.137511 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e68f48-6c52-46b3-934d-a083aed6850a admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:48.142502 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c9690-627e-45c0-adc7-fab159219f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:48.143109 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c9690-627e-45c0-adc7-fab159219f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:48.143391 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c9690-627e-45c0-adc7-fab159219f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:48.143665 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c9690-627e-45c0-adc7-fab159219f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:48.144312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c9690-627e-45c0-adc7-fab159219f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:48.145944 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c9690-627e-45c0-adc7-fab159219f31 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:48.156957 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1477/2916] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 17:20:48.161344 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e209bd4-fbc8-45ba-8004-c27e9f8907c5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:48.171410 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e209bd4-fbc8-45ba-8004-c27e9f8907c5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:48.176245 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ba862-0357-40ef-b332-2e76ad823485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:48.176890 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ba862-0357-40ef-b332-2e76ad823485 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:48.177327 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ba862-0357-40ef-b332-2e76ad823485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:48.177596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ba862-0357-40ef-b332-2e76ad823485 admin admin] PATH_INFO: `/v3/projects/225572611f66481f8d2df42ce727f61f/users/5d75db72d0b543cda7441cda2cc4ede9/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:48.194346 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ba862-0357-40ef-b332-2e76ad823485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225572611f66481f8d2df42ce727f61f, user_id=5d75db72d0b543cda7441cda2cc4ede9, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:48.196977 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ba862-0357-40ef-b332-2e76ad823485 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:48.213418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1440/2917] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:48 2022] PUT /identity/v3/projects/225572611f66481f8d2df42ce727f61f/users/5d75db72d0b543cda7441cda2cc4ede9/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 17:20:48.224995 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2ba75-cea5-409b-abfd-cb164bb7193d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:48.225312 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2ba75-cea5-409b-abfd-cb164bb7193d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:48.225586 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2ba75-cea5-409b-abfd-cb164bb7193d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:48.254981 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-90b2ba75-cea5-409b-abfd-cb164bb7193d None None] MFA Rules not processed for user `5d75db72d0b543cda7441cda2cc4ede9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:48.256217 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-90b2ba75-cea5-409b-abfd-cb164bb7193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:48.322151 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1478/2918] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 17:20:48.333260 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ba862-0357-40ef-b332-2e76ad823485 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:48.335319 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-891ba862-0357-40ef-b332-2e76ad823485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:48.358210 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:48.395566 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ba862-0357-40ef-b332-2e76ad823485 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:48.399418 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03698863-83c0-4ad3-b1d5-46a34d158cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:48.400022 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03698863-83c0-4ad3-b1d5-46a34d158cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:48.400294 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03698863-83c0-4ad3-b1d5-46a34d158cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:48.400565 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03698863-83c0-4ad3-b1d5-46a34d158cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:48.409020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03698863-83c0-4ad3-b1d5-46a34d158cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:48.410523 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03698863-83c0-4ad3-b1d5-46a34d158cd2 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:48.419448 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1441/2919] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:58.319264 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:58.415874 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=17 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:58.536637 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2ba75-cea5-409b-abfd-cb164bb7193d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:58.608321 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2ba75-cea5-409b-abfd-cb164bb7193d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:58.614530 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:58.615165 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:58.615442 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:58.615718 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] PATH_INFO: `/v3/users/5d75db72d0b543cda7441cda2cc4ede9` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:58.616903 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d75db72d0b543cda7441cda2cc4ede9)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:58.618868 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:58.675186 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d75db72d0b543cda7441cda2cc4ede9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:58.675896 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d75db72d0b543cda7441cda2cc4ede9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:58.688998 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d75db72d0b543cda7441cda2cc4ede9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:58.699227 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d75db72d0b543cda7441cda2cc4ede9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:58.699950 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d75db72d0b543cda7441cda2cc4ede9'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:58.712977 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1479/2920] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:20:58 2022] DELETE /identity/v3/users/5d75db72d0b543cda7441cda2cc4ede9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:58.718180 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f86686-3d86-4394-95a1-29d0f58243ea None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:58.718484 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f86686-3d86-4394-95a1-29d0f58243ea None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:58.718746 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f86686-3d86-4394-95a1-29d0f58243ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:58.738642 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d7f86686-3d86-4394-95a1-29d0f58243ea None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:58.739850 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d7f86686-3d86-4394-95a1-29d0f58243ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:58.803224 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1442/2921] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:58.813911 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:58.816318 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:58.881991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e22bb-8c60-4369-8105-b977e20af3c0 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:58.886383 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cea0a-2f3b-4a82-b811-fd4b65baee1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:58.886991 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cea0a-2f3b-4a82-b811-fd4b65baee1f service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:58.887271 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cea0a-2f3b-4a82-b811-fd4b65baee1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:58.887552 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cea0a-2f3b-4a82-b811-fd4b65baee1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:58.897163 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cea0a-2f3b-4a82-b811-fd4b65baee1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:58.898605 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cea0a-2f3b-4a82-b811-fd4b65baee1f service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:58.908210 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1480/2922] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:20:59.203708 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f86686-3d86-4394-95a1-29d0f58243ea None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:59.205438 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d7f86686-3d86-4394-95a1-29d0f58243ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:59.220811 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f86686-3d86-4394-95a1-29d0f58243ea None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:59.227785 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:59.228381 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.228685 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.228909 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] PATH_INFO: `/v3/projects/225572611f66481f8d2df42ce727f61f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.230190 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=225572611f66481f8d2df42ce727f61f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:59.232137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:59.283389 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225572611f66481f8d2df42ce727f61f', 'request_id': 'req-84ddc9da-cfe9-4a4d-811c-82938aed32f8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:59.289387 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225572611f66481f8d2df42ce727f61f', 'request_id': 'req-84ddc9da-cfe9-4a4d-811c-82938aed32f8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:59.298020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225572611f66481f8d2df42ce727f61f', 'request_id': 'req-84ddc9da-cfe9-4a4d-811c-82938aed32f8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:59.309137 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] The token cache is being invalidate because project 225572611f66481f8d2df42ce727f61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:20:59.309425 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:59.310065 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84ddc9da-cfe9-4a4d-811c-82938aed32f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:20:59.311530 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1443/2923] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:20:59 2022] DELETE /identity/v3/projects/225572611f66481f8d2df42ce727f61f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:59.316933 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4f9cd-a0bb-405b-a4bf-4a73e8c898d5 None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.317248 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4f9cd-a0bb-405b-a4bf-4a73e8c898d5 None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.317523 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4f9cd-a0bb-405b-a4bf-4a73e8c898d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.337546 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-80e4f9cd-a0bb-405b-a4bf-4a73e8c898d5 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:59.338768 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-80e4f9cd-a0bb-405b-a4bf-4a73e8c898d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:59.356815 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:59.403888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1481/2924] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:59.412016 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd40b5-1c7a-4961-b72d-872b6c3b3fe0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.412299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd40b5-1c7a-4961-b72d-872b6c3b3fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.412564 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd40b5-1c7a-4961-b72d-872b6c3b3fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.433826 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-40bd40b5-1c7a-4961-b72d-872b6c3b3fe0 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:59.435053 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-40bd40b5-1c7a-4961-b72d-872b6c3b3fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:59.444546 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1444/2925] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:59.448961 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4f9cd-a0bb-405b-a4bf-4a73e8c898d5 None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:59.459121 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4f9cd-a0bb-405b-a4bf-4a73e8c898d5 None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:59.464973 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b871503-83c9-45f6-9add-4bcab0120524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:59.465617 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b871503-83c9-45f6-9add-4bcab0120524 admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.465953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b871503-83c9-45f6-9add-4bcab0120524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.466228 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b871503-83c9-45f6-9add-4bcab0120524 admin admin] PATH_INFO: `/v3/domains` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.466888 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b871503-83c9-45f6-9add-4bcab0120524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 17:20:59.467190 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b871503-83c9-45f6-9add-4bcab0120524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:59.468834 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b871503-83c9-45f6-9add-4bcab0120524 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:59.481462 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1482/2926] 10.222.0.76 () {58 vars in 1153 bytes} [Mon Sep 19 17:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 17:20:59.485821 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd40b5-1c7a-4961-b72d-872b6c3b3fe0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:59.495932 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd40b5-1c7a-4961-b72d-872b6c3b3fe0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:59.502358 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc5818-f534-4680-a741-f4c45bef3490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:59.502964 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc5818-f534-4680-a741-f4c45bef3490 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.503244 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc5818-f534-4680-a741-f4c45bef3490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.503515 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc5818-f534-4680-a741-f4c45bef3490 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.504148 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc5818-f534-4680-a741-f4c45bef3490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:59.506099 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc5818-f534-4680-a741-f4c45bef3490 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:59.538472 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1445/2927] 10.222.0.76 () {60 vars in 1153 bytes} [Mon Sep 19 17:20:59 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 17:20:59.542953 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b871503-83c9-45f6-9add-4bcab0120524 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:59.553206 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b871503-83c9-45f6-9add-4bcab0120524 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:59.620656 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d0d7b-78bc-4a5a-915c-594f43ebe2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:59.621339 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d0d7b-78bc-4a5a-915c-594f43ebe2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.621704 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d0d7b-78bc-4a5a-915c-594f43ebe2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.621979 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d0d7b-78bc-4a5a-915c-594f43ebe2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.622625 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d0d7b-78bc-4a5a-915c-594f43ebe2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:59.624542 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d0d7b-78bc-4a5a-915c-594f43ebe2e3 admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:59.647869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1483/2928] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Sep 19 17:20:59 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 17:20:59.652171 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc5818-f534-4680-a741-f4c45bef3490 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:59.662711 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc5818-f534-4680-a741-f4c45bef3490 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:59.668177 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75bf22-d7aa-4fd1-825c-34269e89b824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:59.668809 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75bf22-d7aa-4fd1-825c-34269e89b824 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.669116 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75bf22-d7aa-4fd1-825c-34269e89b824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.669390 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75bf22-d7aa-4fd1-825c-34269e89b824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.670037 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75bf22-d7aa-4fd1-825c-34269e89b824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:59.671706 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75bf22-d7aa-4fd1-825c-34269e89b824 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:59.681701 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1446/2929] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:59.685590 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d0d7b-78bc-4a5a-915c-594f43ebe2e3 admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:59.695840 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d0d7b-78bc-4a5a-915c-594f43ebe2e3 admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:59.701238 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9c956-ba3e-4fdf-b236-d5ba99f1399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:59.701869 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9c956-ba3e-4fdf-b236-d5ba99f1399c admin admin] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.702173 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9c956-ba3e-4fdf-b236-d5ba99f1399c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.702447 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9c956-ba3e-4fdf-b236-d5ba99f1399c admin admin] PATH_INFO: `/v3/roles` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.703090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9c956-ba3e-4fdf-b236-d5ba99f1399c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:59.704683 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9c956-ba3e-4fdf-b236-d5ba99f1399c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:59.715594 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1484/2930] 10.222.0.76 () {58 vars in 1122 bytes} [Mon Sep 19 17:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 17:20:59.719700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75bf22-d7aa-4fd1-825c-34269e89b824 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:59.730479 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75bf22-d7aa-4fd1-825c-34269e89b824 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:59.736299 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215d7f1-3fc8-46e9-83fb-2c7b545f4f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:59.736949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215d7f1-3fc8-46e9-83fb-2c7b545f4f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.737263 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215d7f1-3fc8-46e9-83fb-2c7b545f4f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.737532 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215d7f1-3fc8-46e9-83fb-2c7b545f4f61 admin admin] PATH_INFO: `/v3/projects/94223245c5a64115944c24163273fdb3/users/4591846c02724ff3b2e94886aa17052d/roles/b86a73fa9cc046eeae600bffd4218e7b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.753810 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215d7f1-3fc8-46e9-83fb-2c7b545f4f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94223245c5a64115944c24163273fdb3, user_id=4591846c02724ff3b2e94886aa17052d, role_id=b86a73fa9cc046eeae600bffd4218e7b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:59.756990 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215d7f1-3fc8-46e9-83fb-2c7b545f4f61 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:59.770440 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1447/2931] 10.222.0.76 () {60 vars in 1483 bytes} [Mon Sep 19 17:20:59 2022] PUT /identity/v3/projects/94223245c5a64115944c24163273fdb3/users/4591846c02724ff3b2e94886aa17052d/roles/b86a73fa9cc046eeae600bffd4218e7b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:20:59.782099 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408cb63-23e8-4a6e-bdbf-41b9a2965e7d None None] REQUEST_METHOD: `POST` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.782392 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408cb63-23e8-4a6e-bdbf-41b9a2965e7d None None] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.782671 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408cb63-23e8-4a6e-bdbf-41b9a2965e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.811080 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.auth.core [None req-a408cb63-23e8-4a6e-bdbf-41b9a2965e7d None None] MFA Rules not processed for user `4591846c02724ff3b2e94886aa17052d`. Rule list: `[]` (Enabled: `True`). {{(pid=81585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:20:59.812218 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-a408cb63-23e8-4a6e-bdbf-41b9a2965e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:59.878974 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1485/2932] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:20:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:20:59.889898 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215d7f1-3fc8-46e9-83fb-2c7b545f4f61 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:20:59.891702 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a215d7f1-3fc8-46e9-83fb-2c7b545f4f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:20:59.914502 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:20:59.953621 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215d7f1-3fc8-46e9-83fb-2c7b545f4f61 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:20:59.957592 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d641c-c2ec-47e2-8c68-543607bac760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7338fa9ff18c42f8bc26710ab8376b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:20:59.958204 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d641c-c2ec-47e2-8c68-543607bac760 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:20:59.958483 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d641c-c2ec-47e2-8c68-543607bac760 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:20:59.958756 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d641c-c2ec-47e2-8c68-543607bac760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:20:59.968684 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d641c-c2ec-47e2-8c68-543607bac760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:20:59.970162 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d641c-c2ec-47e2-8c68-543607bac760 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:20:59.984020 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1448/2933] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:20:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:21:09.876070 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:21:09.977886 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=17 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:21:10.184816 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408cb63-23e8-4a6e-bdbf-41b9a2965e7d None None] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:21:10.250740 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408cb63-23e8-4a6e-bdbf-41b9a2965e7d None None] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:21:10.255758 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:21:10.256393 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:21:10.256672 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:21:10.256975 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] PATH_INFO: `/v3/users/4591846c02724ff3b2e94886aa17052d` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:21:10.258167 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4591846c02724ff3b2e94886aa17052d)` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:21:10.260090 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:21:10.308928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4591846c02724ff3b2e94886aa17052d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:21:10.309620 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4591846c02724ff3b2e94886aa17052d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:21:10.321445 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4591846c02724ff3b2e94886aa17052d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:21:10.329089 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4591846c02724ff3b2e94886aa17052d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:21:10.329703 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.notifications [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4591846c02724ff3b2e94886aa17052d'} {{(pid=81585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:21:10.341610 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1486/2934] 10.222.0.76 () {58 vars in 1224 bytes} [Mon Sep 19 17:21:10 2022] DELETE /identity/v3/users/4591846c02724ff3b2e94886aa17052d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:21:10.346313 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114da4c-7a87-419b-bc2f-99db18a46aa7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:21:10.346633 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114da4c-7a87-419b-bc2f-99db18a46aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:21:10.346907 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114da4c-7a87-419b-bc2f-99db18a46aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:21:10.366888 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a114da4c-7a87-419b-bc2f-99db18a46aa7 None None] MFA Rules not processed for user `a0f31da57ad743c8a3b7c701031f1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 17:21:10.368196 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a114da4c-7a87-419b-bc2f-99db18a46aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:21:10.428233 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1449/2935] 10.222.0.76 () {58 vars in 958 bytes} [Mon Sep 19 17:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 17:21:10.438354 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:21:10.440075 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:21:10.498759 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af9a71-7d05-4b9e-9814-1b343ccf141c admin admin] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:21:10.502948 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6d2b7-755d-436b-b640-8a4783ab137f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da4a83dd0cb64e219bc16f8cf0b0af57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:21:10.503581 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6d2b7-755d-436b-b640-8a4783ab137f service neutron] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:21:10.503875 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6d2b7-755d-436b-b640-8a4783ab137f service neutron] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:21:10.504127 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6d2b7-755d-436b-b640-8a4783ab137f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:21:10.514257 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6d2b7-755d-436b-b640-8a4783ab137f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:21:10.515729 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6d2b7-755d-436b-b640-8a4783ab137f service neutron] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:21:10.525423 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1487/2936] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:21:10.809881 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114da4c-7a87-419b-bc2f-99db18a46aa7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:21:10.811499 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a114da4c-7a87-419b-bc2f-99db18a46aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:21:10.823956 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114da4c-7a87-419b-bc2f-99db18a46aa7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:21:10.830008 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0f31da57ad743c8a3b7c701031f1af9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1401206b2abd4d4db9b2a1ade1bdd499', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:21:10.830671 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:21:10.830949 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:21:10.831223 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] PATH_INFO: `/v3/projects/94223245c5a64115944c24163273fdb3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:21:10.832492 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94223245c5a64115944c24163273fdb3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:21:10.835618 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:21:10.915805 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94223245c5a64115944c24163273fdb3', 'request_id': 'req-98789059-97d5-4dbc-98d1-5a265bf0ae07'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:21:10.923929 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94223245c5a64115944c24163273fdb3', 'request_id': 'req-98789059-97d5-4dbc-98d1-5a265bf0ae07'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:21:10.932146 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94223245c5a64115944c24163273fdb3', 'request_id': 'req-98789059-97d5-4dbc-98d1-5a265bf0ae07'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:21:10.943416 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] The token cache is being invalidate because project 94223245c5a64115944c24163273fdb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 17:21:10.943700 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:21:10.944337 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-98789059-97d5-4dbc-98d1-5a265bf0ae07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 17:21:10.945859 dv-cinder-848013-2-smb devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1450/2937] 10.222.0.76 () {58 vars in 1233 bytes} [Mon Sep 19 17:21:10 2022] DELETE /identity/v3/projects/94223245c5a64115944c24163273fdb3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 17:21:20.521372 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:21:20.940596 dv-cinder-848013-2-smb devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 17:23:17.982140 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6d2b7-755d-436b-b640-8a4783ab137f service neutron] Authenticating user token {{(pid=81585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 17:23:17.983789 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-60d6d2b7-755d-436b-b640-8a4783ab137f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:23:18.072487 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6d2b7-755d-436b-b640-8a4783ab137f service neutron] Validating token access rules against request {{(pid=81585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 17:23:18.141406 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e54c-e6c0-4541-a5cb-ca642c2f8190 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4716f9539151414dadd9e4b8f13ffc0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66ba93fb5d194d92977c52a16dc1e336', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 17:23:18.142230 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e54c-e6c0-4541-a5cb-ca642c2f8190 service placement] REQUEST_METHOD: `GET` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 17:23:18.142621 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e54c-e6c0-4541-a5cb-ca642c2f8190 service placement] SCRIPT_NAME: `/identity` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 17:23:18.142928 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e54c-e6c0-4541-a5cb-ca642c2f8190 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 17:23:18.145726 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.fernet_utils [None req-f900e54c-e6c0-4541-a5cb-ca642c2f8190 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 17:23:18.157793 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e54c-e6c0-4541-a5cb-ca642c2f8190 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 17:23:18.159396 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e54c-e6c0-4541-a5cb-ca642c2f8190 service placement] RBAC: Authorization granted {{(pid=81585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 17:23:18.169644 dv-cinder-848013-2-smb devstack@keystone.service[81585]: [pid: 81585|app: 0|req: 1488/2938] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Sep 19 17:23:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 17:23:28.165531 dv-cinder-848013-2-smb devstack@keystone.service[81585]: DEBUG dbcounter [-] [81585] Writing DB stats keystone:SELECT=58 {{(pid=81585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}